00000001:02000400:0.0F:1788592534.422812:0:3296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788592551.479691:0:3517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788592552.891026:0:3560:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 603 MB/s 00000001:01000000:3.0F:1788592553.142670:0:3560:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 730 MB/s 00000001:01000000:2.0:1788592553.392242:0:3560:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4979 MB/s 00000020:02000000:2.0:1788592553.940306:0:3608:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gae7f7f4 00000400:02000000:0.0:1788592554.673963:0:3623:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.147@tcp [8/256/0/180] 00008000:02000000:3.0:1788592558.402978:0:3773:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788592610.264532:0:5740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788592620.362165:0:6489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788592620.362169:0:6489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788592620.362171:0:6489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788592620.362596:0:6489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000092dcde9d 00000080:02000400:2.0:1788592620.362605:0:6489:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788592620.368597:0:6489:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788592620.368609:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788592620.368711:0:6489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000074d7485d) 00000020:00000080:3.0:1788592620.368729:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788592620.433168:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788592620.433256:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788592620.461849:0:6489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788592620.462106:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788592620.462114:0:6489:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788592620.462125:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db47f8 00000020:01000004:0.0:1788592620.462131:0:6489:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788592620.462135:0:6489:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788592620.462139:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000092dcde9d from MGS 00000020:01000004:0.0:1788592620.462143:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788592620.462160:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c58265b7) 00000020:00000080:0.0:1788592620.462172:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788592620.462267:0:6489:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000092dcde9d from MGS, refs=2 00080000:01000000:0.0:1788592620.462273:0:6489:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788592620.462277:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4806 00000100:00100000:0.0:1788592620.462635:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788592620.462760:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788592620.462767:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0F:1788592620.463439:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788592620.463451:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788592620.465365:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592620.465548:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788592620.465553:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788592620.467221:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788592620.467230:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788592620.471654:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788592620.471666:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788592620.474709:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592620.474715:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592620.474717:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592620.475119:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592620.475122:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592620.475123:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592620.475998:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788592620.482300:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788592620.725223:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3939 MB/s 00000001:01000000:2.0:1788592620.975198:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6295 MB/s 00000001:01000000:2.0:1788592621.225124:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1267 MB/s 00000001:01000000:1.0:1788592621.475753:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1487 MB/s 00080000:10000000:1.0:1788592621.481488:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788592621.491734:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788592621.492877:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788592621.493118:0:6489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788592621.493151:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788592621.493552:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788592621.493576:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788592621.493909:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592621.494057:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788592621.494063:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788592621.494870:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788592621.494877:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788592621.496459:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788592621.496469:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:0.0:1788592621.497520:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592621.498184:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788592621.498205:0:6489:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.147@tcp' 00000020:01000004:1.0:1788592621.498207:0:6489:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1788592621.498398:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1788592621.499361:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.147@tcp (typ=mgc) 00000020:00000080:1.0:1788592621.499383:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.147@tcp (000000004fcae27a) 00000020:00000080:1.0:1788592621.499401:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788592621.499491:0:6489:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000035e05859@MGC192.168.203.147@tcp: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592621.502348:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.147@tcp-0 is initialized 00000040:01000000:2.0:1788592621.502360:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788592621.504290:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788592621.504335:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.147@tcp (uuid ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2) 00000020:00000080:2.0:1788592621.504361:0:6489:0:(genops.c:1385:class_connect()) connect: client ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2, cookie 0xbd314a3362db4814 00000100:00080000:2.0:1788592621.504372:0:6489:0:(import.c:545:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592621.504376:0:6489:0:(import.c:665:import_select_connection()) MGC192.168.203.147@tcp: import 0000000035e05859 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592621.504411:0:6489:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000a672ad6 x1875475225903232/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592621.504426:0:6489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS 00000020:01000004:2.0:1788592621.504445:0:6489:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788592621.504449:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788592621.504464:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002bed6e08) 00000020:00000080:2.0:1788592621.504479:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788592621.505603:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a672ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3638:1875475225903232:0@lo:250: 00000100:00100000:0.0:1788592621.505665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.507611:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225903232 00000100:00100000:0.0:1788592621.507627:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225903232 00000100:00100000:0.0:1788592621.507668:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592621.507683:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000092ab675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1875475225903232:12345-0@lo:250: 00010000:00080000:0.0:1788592621.507710:0:6504:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1788592621.507736:0:6504:0:(genops.c:1385:class_connect()) connect: client ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2, cookie 0xbd314a3362db4822 00000100:00080000:0.0:1788592621.507881:0:6504:0:(import.c:65:import_set_state_nolock()) 000000002a77e60a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592621.507941:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000092ab675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:3638:x1875475225903232:12345-0@lo:250: Request processed in 259us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.507949:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592621.507997:0:3638:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788592621.508006:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 00000100:00080000:0.0:1788592621.508015:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788592621.508020:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788592621.508023:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000035e05859 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788592621.508026:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788592621.508033:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788592621.508039:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a672ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3638:1875475225903232:0@lo:250: 00000100:00100000:2.0:1788592621.515512:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592621.515706:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788592621.515711:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788592621.516640:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788592621.516649:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788592621.518700:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788592621.518712:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788592621.519616:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592621.519801:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788592621.519807:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788592621.520728:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788592621.520736:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788592621.560909:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592621.561199:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788592621.561206:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788592621.562564:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788592621.562575:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788592621.563421:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592621.563587:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788592621.563592:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788592621.564251:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788592621.564258:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788592621.564938:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592621.565183:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788592621.565191:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788592621.565686:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788592621.565693:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788592621.566780:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592621.566958:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788592621.566963:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788592621.567694:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788592621.567701:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788592621.582124:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592621.582582:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788592621.582589:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788592621.583858:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788592621.583869:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788592621.584938:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788592621.584947:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788592621.585871:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788592621.585902:0:6489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788592621.585908:0:6489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788592621.586017:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788592621.586054:0:6489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788592621.586059:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788592621.586060:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592621.586062:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592621.586063:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592621.586146:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592621.586149:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592621.586150:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592621.586152:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592621.586153:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592621.586154:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592621.586155:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592621.586157:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592621.586159:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788592621.586161:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592621.586163:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592621.586164:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592621.586165:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592621.586172:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592621.586174:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592621.586174:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592621.586175:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592621.586176:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592621.586177:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592621.586178:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592621.586179:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592621.586216:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788592621.586233:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903360:0@lo:253: 00000100:00100000:2.0:1788592621.586310:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.586670:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd83b49b going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.586722:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225903360 00000100:00100000:1.0:1788592621.586731:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225903360 00000100:00100000:1.0:1788592621.586822:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592621.586831:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f5b55ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6489:x1875475225903360:12345-0@lo:253: 20000000:01000000:1.0:1788592621.586880:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592621.586882:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788592621.587251:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788592621.587307:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788592621.587643:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592621.588567:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788592621.588748:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592621.588752:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788592621.588757:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788592621.588760:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788592621.588770:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788592621.588901:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592621.589216:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788592621.589231:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788592621.589263:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788592621.589282:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788592621.589300:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788592621.589521:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788592621.589532:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788592621.589559:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788592621.589566:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788592621.589578:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788592621.589583:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788592621.589595:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788592621.589610:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788592621.589640:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788592621.589645:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788592621.589651:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592621.589750:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788592621.589760:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788592621.589788:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788592621.589804:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788592621.589819:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788592621.589828:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788592621.589853:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788592621.589861:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788592621.589873:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788592621.589898:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788592621.589911:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788592621.589919:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788592621.589938:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788592621.589944:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788592621.589955:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788592621.589968:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788592621.590010:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788592621.590026:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788592621.590032:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788592621.590797:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788592621.590994:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788592621.591016:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.147@tcp for mdt 20000000:01000000:1.0:1788592621.591018:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592621.591047:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788592621.591053:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788592621.591236:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788592621.591245:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592621.591260:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788592621.591267:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788592621.591279:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788592621.591294:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788592621.591320:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788592621.591324:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788592621.591327:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788592621.591382:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788592621.591385:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788592621.591783:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788592621.591939:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788592621.591963:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788592621.591979:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788592621.591989:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788592621.591991:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788592621.592452:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788592621.592594:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788592621.592616:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788592621.592631:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788592621.592641:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788592621.592643:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788592621.592647:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788592621.592649:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788592621.592652:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788592621.592657:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788592621.592959:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788592621.593208:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788592621.600444:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788592621.600481:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788592621.600498:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788592621.600518:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788592621.600541:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600557:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600567:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600574:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600580:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600586:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600592:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c2bc36d already unused, calling callback (00000000e5ac922e) 00010000:00010000:0.0:1788592621.600595:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600602:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600614:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600635:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.600640:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c2bc36d/0xbd314a3362db4829 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788592621.600657:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788592621.614495:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f5b55ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6489:x1875475225903360:12345-0@lo:253: Request processed in 27658us (28177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.614510:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592621.614598:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903360:0@lo:253: 10000000:01000000:2.0:1788592621.614614:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788592621.614617:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592621.614619:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592621.614620:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592621.614621:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788592621.614622:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592621.614624:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592621.614625:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592621.614626:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592621.614628:0:6489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788592621.614629:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592621.614630:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788592621.614652:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000092dcde9d from lustre-MDT0000 10000000:01000000:2.0:1788592621.614680:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788592621.614683:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788592621.614688:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff921850ee4d40 10000000:01000000:2.0:1788592621.614692:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592621.614701:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff921850ee4d40 from 1 10000000:01000000:2.0:1788592621.614704:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788592621.614738:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.614750:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.614781:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.614799:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903488:0@lo:101: 00000100:00100000:2.0:1788592621.614854:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.614942:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000043a9660 going to sleep for 11 seconds 00000100:00100000:3.0:1788592621.614991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225903488 00000100:00100000:3.0:1788592621.614997:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225903488 00000100:00100000:3.0:1788592621.615106:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592621.615115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b47fcff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6489:x1875475225903488:12345-0@lo:101: 00010000:00010000:3.0:1788592621.615127:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592621.615140:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4830 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.615162:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4830 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.615171:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4830 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.615178:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd2e00db, rc 0) 00000100:00100000:3.0:1788592621.615207:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b47fcff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:6489:x1875475225903488:12345-0@lo:101: Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592621.615213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592621.615273:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903488:0@lo:101: 00010000:00010000:2.0:1788592621.615285:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.615293:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.615504:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903616:0@lo:501: 00000100:00100000:2.0:1788592621.615531:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.615808:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000043a9660 going to sleep for 11 seconds 00000100:00100000:0.0:1788592621.615843:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225903616 00000100:00100000:0.0:1788592621.615848:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225903616 00000100:00100000:1.0:1788592621.615892:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592621.615901:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025aeb494 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:6489:x1875475225903616:12345-0@lo:501: 00000100:00100000:1.0:1788592621.615991:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025aeb494 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:6489:x1875475225903616:12345-0@lo:501: Request processed in 92us (460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592621.615998:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592621.616108:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903616:0@lo:501: 10000000:01000000:2.0:1788592621.616134:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788592621.616145:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616153:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592621.616161:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff921846c66000 10000000:01000000:2.0:1788592621.616164:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788592621.616173:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff921846c66000 10000000:01000000:2.0:1788592621.616176:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788592621.616178:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff921846c66000 from 1 10000000:01000000:2.0:1788592621.616181:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788592621.616196:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616202:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616209:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.616221:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903744:0@lo:101: 00000100:00100000:2.0:1788592621.616247:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.616268:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000043a9660 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.616427:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225903744 00000100:00100000:1.0:1788592621.616432:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225903744 00000100:00100000:1.0:1788592621.616459:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592621.616464:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c7a28dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:6489:x1875475225903744:12345-0@lo:101: 00010000:00010000:1.0:1788592621.616472:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592621.616482:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c2a14b3/0xbd314a3362db4845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db483e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.616497:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c2a14b3/0xbd314a3362db4845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db483e expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.616504:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c2a14b3/0xbd314a3362db4845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db483e expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.616512:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c2a14b3, rc 0) 00000100:00100000:1.0:1788592621.616534:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c7a28dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+7:6489:x1875475225903744:12345-0@lo:101: Request processed in 71us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.616540:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592621.616599:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903744:0@lo:101: 00010000:00010000:2.0:1788592621.616608:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616616:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592621.616626:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788592621.616641:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616647:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000dc04d53b/0xbd314a3362db483e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592621.616665:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788592621.616668:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592621.616672:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff921846c66000 10000000:01000000:2.0:1788592621.616674:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788592621.616676:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788592621.616678:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788592621.616690:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616696:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.616703:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.616713:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903872:0@lo:101: 00000100:00100000:2.0:1788592621.616739:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.616749:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000043a9660 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.616820:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225903872 00000100:00100000:1.0:1788592621.616824:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225903872 00000100:00100000:1.0:1788592621.616841:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592621.616846:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b2199b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+7:6489:x1875475225903872:12345-0@lo:101: 00010000:00010000:1.0:1788592621.616852:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592621.616860:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db484c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.616882:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db484c expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.616888:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db484c expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.616894:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce1a1cb2, rc 0) 00000100:00100000:1.0:1788592621.616919:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b2199b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+8:6489:x1875475225903872:12345-0@lo:101: Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.616925:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592621.617116:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225903872:0@lo:101: 00010000:00010000:2.0:1788592621.617126:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.617132:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.617173:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904000:0@lo:501: 00000100:00100000:2.0:1788592621.617200:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.617222:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000043a9660 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.617320:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904000 00000100:00100000:1.0:1788592621.617325:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904000 00000100:00100000:1.0:1788592621.617441:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788592621.617448:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe38572b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+8:6489:x1875475225904000:12345-0@lo:501: 00000100:00100000:1.0:1788592621.617537:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe38572b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6489:x1875475225904000:12345-0@lo:501: Request processed in 90us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.617543:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592621.617607:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904000:0@lo:501: 00000100:00100000:2.0:1788592621.617635:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904128:0@lo:503: 00000100:00100000:2.0:1788592621.617672:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.617701:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000043a9660 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.617745:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904128 00000100:00100000:1.0:1788592621.617749:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904128 00000100:00100000:1.0:1788592621.617765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592621.617769:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cc9cccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6489:x1875475225904128:12345-0@lo:503: 00000100:00100000:1.0:1788592621.617845:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cc9cccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6489:x1875475225904128:12345-0@lo:503: Request processed in 76us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.617851:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592621.617915:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904128:0@lo:503: 00000100:00100000:2.0:1788592621.618224:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6534:1875475225904256:0@lo:502: 00000100:00100000:2.0:1788592621.618256:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.618278:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024b3b7b2 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.618310:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904256 00000100:00100000:1.0:1788592621.618313:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904256 00000100:00100000:1.0:1788592621.618325:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592621.618333:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7d7a8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6534:x1875475225904256:12345-0@lo:502: 00000100:00100000:1.0:1788592621.618399:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7d7a8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6534:x1875475225904256:12345-0@lo:502: Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.618403:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592621.618509:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6534:1875475225904256:0@lo:502: 00000020:01000000:2.0:1788592621.618530:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592621.618540:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592621.618543:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788592621.618549:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788592621.618551:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592621.618568:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007a2aa662) 00000020:00000080:2.0:1788592621.618586:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788592621.618591:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788592621.618681:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788592621.618696:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4861 00000020:00000080:2.0:1788592621.618945:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788592621.618948:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592621.618951:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592621.618952:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788592621.618954:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592621.618956:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592621.618957:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788592621.618959:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592621.618964:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d75456b9) 00000020:00000080:2.0:1788592621.618975:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788592621.618978:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788592621.618979:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788592621.618981:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788592621.618984:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788592621.619026:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000092dcde9d from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788592621.619034:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007da7ae05) 00000020:00000080:2.0:1788592621.619039:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788592621.619116:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788592621.619122:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db4876 00000020:00000080:2.0:1788592621.619234:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788592621.619241:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788592621.619245:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbd314a3362db487d 00080000:01000000:2.0:1788592621.619250:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788592621.619253:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4884 00080000:10000000:2.0:1788592621.619976:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788592621.620183:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788592621.623028:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788592621.674784:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788592621.675063:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788592621.677450:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788592621.677833:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788592621.680471:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ec675ebf) 00000020:00000080:3.0:1788592621.680490:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788592621.680560:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788592621.680567:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4892 00000020:00000080:3.0:1788592621.681185:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788592621.682029:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788592621.691294:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788592621.693050:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788592621.701478:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788592621.703200:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788592621.709457:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788592621.711364:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbd314a3362db4899 00000020:00000080:1.0:1788592621.712766:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788592621.712789:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592621.712796:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592621.712798:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788592621.712803:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592621.712993:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592621.712994:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788592621.712997:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788592621.712998:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788592621.713000:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592621.713002:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592621.713002:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788592621.713004:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592621.713007:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592621.713007:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788592621.713010:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788592621.713046:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788592621.713197:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca116753 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6534:1875475225904384:0@lo:502: 00000100:00100000:0.0:1788592621.713270:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.713324:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000001503e530 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.713379:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904384 00000100:00100000:1.0:1788592621.713386:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904384 00000100:00100000:1.0:1788592621.713428:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592621.713437:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000075609d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6534:x1875475225904384:12345-0@lo:502: 00000100:00100000:1.0:1788592621.713553:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000075609d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6534:x1875475225904384:12345-0@lo:502: Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.713560:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592621.713718:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca116753 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6534:1875475225904384:0@lo:502: 00000020:01000000:0.0:1788592621.713743:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592621.713747:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592621.713749:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788592621.713752:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788592621.714058:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788592621.714113:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788592621.714136:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.714147:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592621.714154:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921846c66000 from 1 10000000:01000000:1.0:1788592621.714157:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788592621.714186:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.714193:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.714202:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592621.714214:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bff82279 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904512:0@lo:101: 00000100:00100000:1.0:1788592621.714245:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592621.714266:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000512127c1 going to sleep for 11 seconds 00000100:00100000:2.0:1788592621.714323:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904512 00000100:00100000:2.0:1788592621.714329:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904512 00000100:00100000:2.0:1788592621.714362:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592621.714369:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000470cea41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:6489:x1875475225904512:12345-0@lo:101: 00010000:00010000:2.0:1788592621.714378:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592621.714390:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db48a0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.714408:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.714418:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.714434:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000396d071b, rc 0) 00000100:00100000:2.0:1788592621.714478:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000470cea41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:6489:x1875475225904512:12345-0@lo:101: Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592621.714484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788592621.714856:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bff82279 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904512:0@lo:101: 00010000:00010000:0.0:1788592621.714868:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.714877:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592621.716559:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904640:0@lo:256: 00000100:00100000:0.0:1788592621.716715:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.716763:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000001503e530 going to sleep for 11 seconds 00000100:00100000:3.0:1788592621.716860:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904640 00000100:00100000:3.0:1788592621.716868:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904640 00000100:00100000:3.0:1788592621.716914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592621.716921:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000760ba94c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:6489:x1875475225904640:12345-0@lo:256: 20000000:01000000:3.0:1788592621.716940:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788592621.716945:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788592621.717147:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000760ba94c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:6489:x1875475225904640:12345-0@lo:256: Request processed in 226us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592621.717155:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592621.717226:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904640:0@lo:256: 10000000:01000000:0.0:1788592621.717952:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788592621.717974:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.717985:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592621.717993:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921846c66000 from 1 10000000:01000000:0.0:1788592621.717995:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592621.718024:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.718032:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.718040:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592621.718054:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904768:0@lo:101: 00000100:00100000:0.0:1788592621.718157:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.718178:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000001503e530 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.718277:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904768 00000100:00100000:1.0:1788592621.718282:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904768 00000100:00100000:1.0:1788592621.718312:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592621.718317:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041c87b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:6489:x1875475225904768:12345-0@lo:101: 00010000:00010000:1.0:1788592621.718324:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592621.718333:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db48ae expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.718362:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db48ae expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.718384:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48ae expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.718392:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073d91a0f, rc 0) 00000100:00100000:1.0:1788592621.718425:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041c87b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6489:x1875475225904768:12345-0@lo:101: Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.718431:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592621.718450:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904768:0@lo:101: 00010000:00010000:0.0:1788592621.718462:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.718470:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592621.718527:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904896:0@lo:501: 00000100:00100000:0.0:1788592621.718551:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.718572:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000001503e530 going to sleep for 11 seconds 00000100:00100000:2.0:1788592621.718733:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225904896 00000100:00100000:2.0:1788592621.718739:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225904896 00000100:00100000:2.0:1788592621.718769:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592621.718785:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e92a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6489:x1875475225904896:12345-0@lo:501: 00000100:00100000:2.0:1788592621.718971:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e92a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6489:x1875475225904896:12345-0@lo:501: Request processed in 186us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592621.718979:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592621.719250:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225904896:0@lo:501: 00000100:00100000:0.0:1788592621.719279:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905024:0@lo:503: 00000100:00100000:0.0:1788592621.719324:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.719426:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000001503e530 going to sleep for 11 seconds 00000100:00100000:3.0:1788592621.719458:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905024 00000100:00100000:3.0:1788592621.719463:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905024 00000100:00100000:3.0:1788592621.719496:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592621.719502:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003564400c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6489:x1875475225905024:12345-0@lo:503: 00000040:00080000:3.0:1788592621.719526:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592621.719560:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003564400c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6489:x1875475225905024:12345-0@lo:503: Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592621.719570:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592621.719589:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905024:0@lo:503: 00000040:00080000:2.0:1788592621.720632:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788592621.720785:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788592621.720800:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592621.720816:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.720826:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592621.720870:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788592621.720873:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff921846c66000 10000000:01000000:0.0:1788592621.720876:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff921846c66000 10000000:01000000:0.0:1788592621.720880:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592621.720885:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921846c66000 from 1 10000000:01000000:0.0:1788592621.720887:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592621.720913:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.720920:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.720936:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592621.720954:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905152:0@lo:101: 00000100:00100000:0.0:1788592621.720994:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.721032:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dad4a3e going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.721205:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905152 00000100:00100000:1.0:1788592621.721212:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905152 00000100:00100000:1.0:1788592621.721251:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592621.721258:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d1abc5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6489:x1875475225905152:12345-0@lo:101: 00010000:00010000:1.0:1788592621.721272:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592621.721284:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db48bc expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.721304:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db48bc expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.721312:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48bc expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.721319:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075e558a0, rc 0) 00000100:00100000:1.0:1788592621.721371:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d1abc5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905152:12345-0@lo:101: Request processed in 114us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.721378:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592621.721709:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905152:0@lo:101: 00010000:00010000:0.0:1788592621.721724:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.721733:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592621.721796:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905280:0@lo:501: 00000100:00100000:0.0:1788592621.721837:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.721868:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dad4a3e going to sleep for 11 seconds 00000100:00100000:2.0:1788592621.721900:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905280 00000100:00100000:2.0:1788592621.721909:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905280 00000100:00100000:2.0:1788592621.721941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592621.721948:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000760137b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905280:12345-0@lo:501: 00000100:00100000:2.0:1788592621.722047:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000760137b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905280:12345-0@lo:501: Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592621.722054:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788592621.722196:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905280:0@lo:501: 00000100:00100000:0.0:1788592621.722473:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905408:0@lo:503: 00000100:00100000:0.0:1788592621.722512:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.722541:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dad4a3e going to sleep for 11 seconds 00000100:00100000:3.0:1788592621.722593:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905408 00000100:00100000:3.0:1788592621.722598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905408 00000100:00100000:3.0:1788592621.722703:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592621.722712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000961f52ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905408:12345-0@lo:503: 00000100:00100000:3.0:1788592621.722848:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000961f52ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905408:12345-0@lo:503: Request processed in 138us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592621.722854:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592621.722919:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905408:0@lo:503: 00000100:00100000:1.0:1788592621.725063:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007dabd640 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6539:1875475225905536:0@lo:502: 00000100:00100000:0.0:1788592621.725633:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.725678:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000007aa3ed5f going to sleep for 11 seconds 00000100:00100000:2.0:1788592621.726609:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905536 00000100:00100000:2.0:1788592621.726620:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905536 00000100:00100000:2.0:1788592621.726672:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592621.726682:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001479b765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6539:x1875475225905536:12345-0@lo:502: 00000100:00100000:2.0:1788592621.726838:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001479b765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6539:x1875475225905536:12345-0@lo:502: Request processed in 157us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592621.726846:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592621.726872:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007dabd640 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6539:1875475225905536:0@lo:502: 00000020:01000004:0.0:1788592621.726935:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788592621.726954:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000573b7492) 00000020:00000080:0.0:1788592621.726970:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788592621.727056:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000092dcde9d from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788592621.727060:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000092dcde9d from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788592621.727063:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000092dcde9d 4 00010000:00080000:0.0:1788592621.727288:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000056103ae9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1788592621.730897:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788592621.731129:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788592621.731165:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788592621.731185:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbd314a3362db48d1 00000100:00080000:0.0:1788592621.731194:0:6539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592621.731199:0:6539:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000056103ae9 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592621.731229:0:6539:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e7a20dde x1875475225905664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788592621.731249:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788592621.731456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475225905664:0@lo:38: 00000100:00100000:1.0:1788592621.731526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592621.731599:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905664 00000100:00100000:1.0:1788592621.731606:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905664 00000100:00100000:1.0:1788592621.731633:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592621.731640:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e760e031 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475225905664:12345-0@lo:38: 00000100:00100000:1.0:1788592621.731848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e760e031 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475225905664:12345-0@lo:38: Request processed in 207us (322us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788592621.731856:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592621.731889:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592621.731895:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000056103ae9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592621.731909:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788592621.731912:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a20dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475225905664:0@lo:38: 00000100:00100000:2.0:1788592621.735461:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6539:1875475225905792:0@lo:502: 00000100:00100000:2.0:1788592621.735658:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.735701:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024b3b7b2 going to sleep for 11 seconds 00000100:00100000:1.0:1788592621.735749:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905792 00000100:00100000:1.0:1788592621.735757:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905792 00000100:00100000:1.0:1788592621.735813:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592621.735821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e2893f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6539:x1875475225905792:12345-0@lo:502: 00000100:00100000:1.0:1788592621.735947:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e2893f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6539:x1875475225905792:12345-0@lo:502: Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.735955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592621.736107:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6539:1875475225905792:0@lo:502: 00000040:00080000:2.0:1788592621.736132:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788592621.736468:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788592621.736499:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592621.736617:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.736628:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788592621.736671:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788592621.736677:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592621.736678:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592621.736679:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592621.736680:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592621.736681:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592621.736682:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592621.736683:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592621.736685:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788592621.736686:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788592621.736687:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592621.736688:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788592621.736691:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788592621.736694:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788592621.736695:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592621.736696:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592621.736697:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592621.736698:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592621.736699:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592621.736699:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592621.736700:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592621.736701:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788592621.736701:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788592621.736702:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592621.736703:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788592621.736718:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788592621.736728:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000450b1a88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905920:0@lo:253: 00000100:00100000:1.0:1788592621.736762:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592621.736824:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079adbaa3 going to sleep for 11 seconds 00000100:00100000:2.0:1788592621.736976:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225905920 00000100:00100000:2.0:1788592621.736981:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225905920 00000100:00100000:2.0:1788592621.737055:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592621.737061:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4673a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905920:12345-0@lo:253: 20000000:01000000:2.0:1788592621.737097:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788592621.737108:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788592621.742979:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788592621.742997:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788592621.743115:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592621.743120:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592621.743137:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.743156:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.743163:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.743211:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592621.743226:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592621.743240:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225906048:0@lo:104: 00000100:00100000:3.0:1788592621.743321:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592621.743359:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013216687 going to sleep for 11 seconds 00000100:00100000:0.0:1788592621.743575:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906048 00000100:00100000:0.0:1788592621.743583:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906048 00000100:00100000:0.0:1788592621.743629:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592621.743637:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff557f90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225906048:12345-0@lo:104: 00010000:00010000:0.0:1788592621.743648:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592621.743712:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592621.743717:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff557f90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225906048:12345-0@lo:104: Request processed in 82us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.743724:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592621.743742:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4673a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6489:x1875475225905920:12345-0@lo:253: Request processed in 6681us (6979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592621.743750:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592621.743806:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000450b1a88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6489:1875475225905920:0@lo:253: 10000000:01000000:2.0:1788592621.743816:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788592621.743819:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592621.743821:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592621.743822:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592621.743823:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592621.743824:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592621.743826:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592621.743827:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592621.743828:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592621.743829:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592621.743831:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592621.743832:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592621.743834:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788592621.743855:0:6489:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788592621.743870:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225906048:0@lo:104: 00010000:00010000:3.0:1788592621.743881:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.743982:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592621.743988:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.743995:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7276cad already unused, calling callback (00000000800d70aa) 10000000:00010000:1.0:1788592621.743997:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.744005:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592621.744019:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592621.744023:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592621.744102:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.744109:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592621.744133:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.744140:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db48a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48a7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.744153:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592621.744154:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592621.744156:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592621.744202:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592621.744211:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6985da5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225906176:0@lo:103: 00000100:00100000:1.0:1788592621.744241:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592621.756491:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906176 00000100:00100000:2.0:1788592621.756524:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906176 00010000:00010000:2.0:1788592621.756556:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.756598:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592621.756606:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d04b3305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:3639:x1875475225906176:12345-0@lo:103: 00010000:00010000:2.0:1788592621.756620:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592621.756625:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756636:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756651:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000396d071b/0xbd314a3362db48a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db48a0 expref: 12 pid: 6507 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756665:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756673:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592621.756689:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013569569s 00010000:00010000:2.0:1788592621.756693:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756699:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756705:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756720:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756726:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f3468cd already unused, calling callback (00000000e5ac922e) 00010000:00010000:2.0:1788592621.756730:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756736:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756758:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592621.756781:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592621.756798:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.756806:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592621.756811:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f3468cd/0xbd314a3362db48d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592621.756854:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d04b3305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:3639:x1875475225906176:12345-0@lo:103: Request processed in 249us (12613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592621.756862:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592621.756862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6985da5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225906176:0@lo:103: 00080000:10000000:2.0:1788592621.758521:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788592621.758745:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788592621.758958:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788592621.759174:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788592621.759523:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788592621.759663:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788592621.760751:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788592621.760906:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788592621.761056:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788592621.761579:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788592621.761828:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788592621.762006:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788592621.764959:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788592621.775793:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788592621.775887:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788592621.775891:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788592621.776301:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788592621.778264:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788592621.778489:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788592621.779061:0:6489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788592621.779167:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788592621.779918:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592621.781224:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788592621.782663:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788592621.782723:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788592621.785972:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788592621.786325:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788592621.787103:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788592621.787248:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788592621.787399:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788592621.787543:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788592621.787683:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788592621.787862:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788592621.788018:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788592621.788236:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788592621.788422:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000040:00080000:2.0:1788592621.788446:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1788592621.788903:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788592621.789166:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788592621.793786:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788592621.793972:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788592621.794152:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788592621.794326:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788592621.794559:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788592621.794934:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788592621.795221:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788592621.795362:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788592621.795515:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788592621.795650:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788592621.795815:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000040:00080000:2.0:1788592621.795864:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788592621.795955:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788592621.795956:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000004:00080000:2.0:1788592621.795963:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788592621.796374:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788592621.796508:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788592621.796675:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788592621.796860:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788592621.797032:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788592621.797340:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788592621.797492:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788592621.797639:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788592621.797797:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788592621.798335:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788592621.801107:0:6489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788592621.801155:0:6489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb76c81cbb988 00100000:10000000:0.0:1788592621.801164:0:6489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788592621.802235:0:6489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592621.802247:0:6489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592621.802262:0:6489:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788592621.802275:0:6489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788592621.803174:0:6489:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592621.803401:0:6489:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788592622.521970:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592623.544803:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592624.571425:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592625.599876:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592625.617460:0:6790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788592626.527781:0:6842:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592626.527974:0:6842:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788592626.620499:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592627.001022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788592627.001031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788592627.001045:0:37:0:(import.c:65:import_set_state_nolock()) 0000000056103ae9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592627.001056:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000056103ae9 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592627.001096:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001cfbe0de x1875475225906432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788592627.001132:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cfbe0de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475225906432:0@lo:38: 00000100:00100000:3.0:1788592627.001211:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592627.001979:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225906304:0@lo:400: 00000100:00100000:1.0:1788592627.002022:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592627.002475:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906304 00000100:00100000:3.0:1788592627.002484:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906304 00000100:00100000:3.0:1788592627.002520:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592627.002528:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b720210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:3641:x1875475225906304:12345-0@lo:400: 00000100:00100000:3.0:1788592627.002583:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b720210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:3641:x1875475225906304:12345-0@lo:400: Request processed in 55us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592627.002591:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592627.002637:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225906304:0@lo:400: 00000100:00100000:0.0:1788592627.003089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906432 00000100:00100000:0.0:1788592627.003094:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906432 00000100:00100000:1.0:1788592627.003128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592627.003134:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feacac67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475225906432:12345-0@lo:38: 00010000:00080000:1.0:1788592627.003156:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:1.0:1788592627.003188:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbd314a3362db48df 00000004:00100000:1.0:1788592627.003233:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788592627.003464:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000b9926acb : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592627.005467:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feacac67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875475225906432:12345-0@lo:38: Request processed in 2325us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592627.005481:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788592627.009467:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001cfbe0de x1875475225906432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788592627.009497:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788592627.009589:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788592627.009594:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788592627.009597:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000056103ae9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788592627.009604:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cfbe0de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475225906432:0@lo:38: 00010000:00010000:1.0:1788592627.643829:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788592628.024153:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788592628.024160:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921846c66000 from 3 10000000:01000000:3.0:1788592628.024165:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592628.024207:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592628.024284:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592628.024294:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592628.024317:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225906560:0@lo:101: 00000100:00100000:3.0:1788592628.024507:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592628.024641:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906560 00000100:00100000:2.0:1788592628.024649:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906560 00000100:00100000:2.0:1788592628.024695:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592628.024708:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eb96a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:6509:x1875475225906560:12345-0@lo:101: 00010000:00010000:2.0:1788592628.024722:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592628.024745:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db48e6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592628.024750:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016c6a8d9 going to sleep for 11 seconds 00010000:00010000:2.0:1788592628.024768:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592628.024782:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592628.024790:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069052dc7, rc 0) 00000100:00100000:2.0:1788592628.024838:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eb96a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6509:x1875475225906560:12345-0@lo:101: Request processed in 132us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592628.024844:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788592628.025396:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225906560:0@lo:101: 00010000:00010000:3.0:1788592628.025412:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592628.025486:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592628.025538:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225906688:0@lo:256: 00000100:00100000:3.0:1788592628.025653:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592628.025927:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906688 00000100:00100000:1.0:1788592628.025933:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906688 00000100:00100000:1.0:1788592628.025972:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592628.025978:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e450cd55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6509:x1875475225906688:12345-0@lo:256: 20000000:01000000:1.0:1788592628.025993:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788592628.026008:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788592628.026012:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788592628.026109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e450cd55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6509:x1875475225906688:12345-0@lo:256: Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592628.026116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788592628.026300:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016c6a8d9 going to sleep for 11 seconds 00000100:00100000:3.0:1788592628.026316:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225906688:0@lo:256: 10000000:01000000:3.0:1788592628.026352:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788592628.026408:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592628.026417:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592628.666622:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788592629.195356:0:6943:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788592629.195677:0:6943:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788592629.691375:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592630.713332:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592631.737111:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592632.120391:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592632.120527:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000477df80c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225906944:0@lo:400: 00000100:00100000:1.0:1788592632.120602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592632.120625:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225906816:0@lo:400: 00000100:00100000:3.0:1788592632.120668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592632.120683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906944 00000100:00100000:0.0:1788592632.120692:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906944 00000100:00100000:1.0:1788592632.120808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592632.120817:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6985da5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225906944:12345-0@lo:400: 00000100:00100000:2.0:1788592632.120846:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225906816 00000100:00100000:2.0:1788592632.120853:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225906816 00000100:00100000:1.0:1788592632.120873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6985da5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225906944:12345-0@lo:400: Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592632.120881:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788592632.120920:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000477df80c x1875475225906944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592632.120932:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000477df80c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225906944:0@lo:400: 00000100:00100000:2.0:1788592632.120939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592632.120949:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009559c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:3641:x1875475225906816:12345-0@lo:400: 00000100:00100000:2.0:1788592632.121007:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009559c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:3641:x1875475225906816:12345-0@lo:400: Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592632.121014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788592632.121091:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5bdfbe7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225906816:0@lo:400: 00010000:00010000:1.0:1788592632.760280:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592633.785458:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592634.812195:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592635.832523:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592636.857664:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592637.240322:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7d2d76f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225907200:0@lo:400: 00000100:00100000:0.0:1788592637.240393:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592637.240537:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592637.240547:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002eb288dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225907072:0@lo:400: 00000100:00100000:2.0:1788592637.240582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.240734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907200 00000100:00100000:1.0:1788592637.240742:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907200 00000100:00100000:1.0:1788592637.240794:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592637.240802:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056ac5fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225907200:12345-0@lo:400: 00000100:00100000:0.0:1788592637.240879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907072 00000100:00100000:0.0:1788592637.240883:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907072 00000100:00100000:0.0:1788592637.240912:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788592637.240918:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5b706e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:3639:x1875475225907072:12345-0@lo:400: 00000100:00100000:0.0:1788592637.240951:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5b706e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:3639:x1875475225907072:12345-0@lo:400: Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592637.240957:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788592637.241003:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002eb288dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225907072:0@lo:400: 00000100:00100000:1.0:1788592637.250407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056ac5fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225907200:12345-0@lo:400: Request processed in 9596us (10005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.250424:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592637.250616:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b7d2d76f x1875475225907200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592637.250634:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7d2d76f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225907200:0@lo:400: 00000020:01000004:3.0:1788592637.393644:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788592637.393648:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788592637.393650:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788592637.393801:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ed1f4e8a 00000020:01000004:3.0:1788592637.393822:0:7442:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788592637.393833:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788592637.393844:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000007c098c25) 00000020:00000080:3.0:1788592637.393857:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788592637.464695:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788592637.464779:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788592637.499926:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788592637.504969:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788592637.504982:0:7442:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788592637.504994:0:7442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db48fb 00000020:01000004:0.0:1788592637.505006:0:7442:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788592637.505027:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788592637.505030:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788592637.505036:0:7442:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788592637.505078:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788592637.505083:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788592637.527712:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788592637.527750:0:7442:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.147@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788592637.527755:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788592637.527757:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592637.527758:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592637.527759:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592637.527761:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592637.527762:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592637.527763:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592637.527765:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592637.527766:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592637.527768:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592637.527769:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788592637.527772:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788592637.527774:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592637.527775:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592637.527776:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592637.527777:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592637.527778:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592637.527779:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592637.527780:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592637.527781:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592637.527782:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592637.527783:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592637.527784:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788592637.527817:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788592637.527833:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002eb288dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225907328:0@lo:253: 00000100:00100000:0.0:1788592637.527900:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.527997:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000123c4935 going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.528046:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907328 00000100:00100000:2.0:1788592637.528054:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907328 00000100:00100000:2.0:1788592637.528620:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592637.528629:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c0b2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:7442:x1875475225907328:12345-0@lo:253: 20000000:01000000:2.0:1788592637.528657:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788592637.528661:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788592637.528674:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788592637.528679:0:6504:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788592637.528713:0:6504:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788592637.528893:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592637.529008:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788592637.529022:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788592637.529039:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788592637.529571:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788592637.529597:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788592637.529656:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788592637.529677:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788592637.529691:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788592637.529697:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788592637.529708:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788592637.529712:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788592637.529724:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788592637.529738:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788592637.529833:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788592637.529841:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788592637.529865:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788592637.529872:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788592637.529884:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788592637.529889:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:3.0:1788592637.529900:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788592637.529905:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788592637.529918:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788592637.529933:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788592637.529942:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788592637.530013:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788592637.530023:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788592637.530034:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788592637.530050:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788592637.530194:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788592637.530204:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788592637.530229:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788592637.530380:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788592637.530394:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788592637.530415:0:6504:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788592637.530421:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788592637.530717:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788592637.530902:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788592637.530920:0:6504:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.147@tcp for mdt 20000000:01000000:3.0:1788592637.530922:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788592637.530936:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788592637.530941:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788592637.530954:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788592637.530959:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:3.0:1788592637.530974:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788592637.530982:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788592637.530996:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788592637.531011:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788592637.531050:0:6504:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788592637.531057:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788592637.531758:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788592637.531898:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788592637.531914:0:6504:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.147@tcp for mdt 20000000:01000000:3.0:1788592637.531916:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788592637.531931:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788592637.531937:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788592637.531964:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788592637.531971:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:3.0:1788592637.531983:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788592637.531989:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788592637.532001:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788592637.532016:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788592637.532035:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788592637.532044:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788592637.532047:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788592637.532453:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788592637.532456:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788592637.532765:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788592637.532788:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788592637.532801:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788592637.532929:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788592637.532950:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788592637.532972:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788592637.532980:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788592637.532982:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788592637.533599:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788592637.533621:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788592637.533635:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788592637.533768:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788592637.533787:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788592637.533800:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788592637.533807:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788592637.533809:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788592637.534041:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788592637.534057:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788592637.534364:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788592637.534493:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788592637.534513:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788592637.534529:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788592637.534540:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788592637.534543:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788592637.534547:0:6504:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788592637.534553:0:6504:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788592637.534794:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788592637.534880:0:6504:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788592637.543183:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788592637.543212:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543230:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4830 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543296:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db484c expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543302:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48bc expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543307:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543360:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db48bc expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543373:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db48bc expref: 12 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.543389:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225907456:0@lo:104: 00000100:00100000:3.0:1788592637.543453:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592637.543565:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db484c expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543573:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db484c expref: 12 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.543580:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225907584:0@lo:104: 00000100:00100000:3.0:1788592637.543602:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592637.543739:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4830 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.543747:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4830 expref: 12 pid: 6505 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.543754:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f7cd02e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225907712:0@lo:104: 00000100:00100000:3.0:1788592637.543775:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.543835:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907456 00000100:00100000:1.0:1788592637.543843:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907456 00000100:00100000:1.0:1788592637.543878:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907584 00000100:00100000:1.0:1788592637.543881:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907584 00000100:00100000:1.0:1788592637.543893:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592637.543900:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d8c7a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225907456:12345-0@lo:104: 00010000:00010000:1.0:1788592637.543912:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.543977:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592637.543982:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d8c7a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225907456:12345-0@lo:104: Request processed in 83us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.543990:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592637.544007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592637.544013:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f993366 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225907584:12345-0@lo:104: 00010000:00010000:1.0:1788592637.544021:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544053:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788592637.544057:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f993366 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225907584:12345-0@lo:104: Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.544062:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788592637.544096:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592637.544101:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544108:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000f945055 already unused, calling callback (00000000800d70aa) 10000000:00010000:1.0:1788592637.544111:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544118:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592637.544125:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.544130:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592637.544162:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544169:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592637.544185:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544190:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 000000000f945055/0xbd314a3362db48bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48c3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544205:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592637.544207:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544212:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e3ee70e already unused, calling callback (00000000800d70aa) 10000000:00010000:1.0:1788592637.544214:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544220:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592637.544225:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.544229:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592637.544260:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544267:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592637.544278:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544293:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 000000001e3ee70e/0xbd314a3362db484c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4853 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544302:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592637.544304:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592637.544305:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592637.544322:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225907840:0@lo:103: 00000100:00100000:1.0:1788592637.544350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.544380:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225907968:0@lo:103: 00000100:00100000:1.0:1788592637.544402:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.544432:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907840 00000100:00100000:1.0:1788592637.544435:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907840 00010000:00010000:1.0:1788592637.544451:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48bc expref: 13 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.544469:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907968 00000100:00100000:1.0:1788592637.544472:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907968 00010000:00010000:1.0:1788592637.544480:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db484c expref: 14 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.544490:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592637.544495:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005abf4030 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:3642:x1875475225907840:12345-0@lo:103: 00010000:00010000:1.0:1788592637.544504:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592637.544508:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48bc expref: 14 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544516:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db48bc expref: 14 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544537:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592637.544560:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005abf4030 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:3642:x1875475225907840:12345-0@lo:103: Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.544566:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592637.544575:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592637.544580:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c71c76f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:3639:x1875475225907968:12345-0@lo:103: 00010000:00010000:1.0:1788592637.544586:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592637.544588:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db484c expref: 13 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544594:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db484c expref: 13 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.544602:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592637.544621:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c71c76f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:3639:x1875475225907968:12345-0@lo:103: Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.544626:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592637.544658:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225907968:0@lo:103: 00000100:00100000:1.0:1788592637.544692:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225907840:0@lo:103: 00010000:00010000:2.0:1788592637.544881:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592637.545062:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set 00000000588009a9 going to sleep for 11 seconds 00010000:00010000:3.0:1788592637.545089:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075e558a0/0xbd314a3362db48c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db48bc expref: 12 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.545098:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b5832d3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225907456:0@lo:104: 00010000:00010000:3.0:1788592637.545115:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce1a1cb2/0xbd314a3362db4853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db484c expref: 11 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.545122:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225907584:0@lo:104: 00000100:00100000:1.0:1788592637.545614:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225907712 00000100:00100000:1.0:1788592637.545620:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225907712 00000100:00100000:1.0:1788592637.545643:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592637.545649:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009db09849 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225907712:12345-0@lo:104: 00010000:00010000:1.0:1788592637.545659:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.545737:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592637.545742:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009db09849 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225907712:12345-0@lo:104: Request processed in 94us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.545749:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592637.545809:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f7cd02e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225907712:0@lo:104: 00010000:00010000:3.0:1788592637.545829:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.545878:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592637.545882:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.545899:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d666d10 already unused, calling callback (00000000800d70aa) 10000000:00010000:2.0:1788592637.545902:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.545908:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592637.545914:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592637.545919:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592637.545951:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.545958:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592637.545977:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.545983:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 000000006d666d10/0xbd314a3362db4830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4837 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.545997:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592637.545999:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592637.546001:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592637.546038:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee83c3d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225908096:0@lo:103: 00000100:00100000:3.0:1788592637.546105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.546359:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908096 00000100:00100000:1.0:1788592637.546364:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908096 00010000:00010000:1.0:1788592637.546381:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4830 expref: 11 pid: 6505 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.546408:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592637.546414:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f7cd02e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:3640:x1875475225908096:12345-0@lo:103: 00010000:00010000:1.0:1788592637.546423:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592637.546427:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4830 expref: 11 pid: 6505 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546437:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4830 expref: 11 pid: 6505 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546448:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd2e00db/0xbd314a3362db4837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4830 expref: 11 pid: 6505 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546461:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546469:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546483:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546500:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546507:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546512:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546518:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003031ef2e already unused, calling callback (00000000e5ac922e) 00010000:00010000:1.0:1788592637.546521:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546528:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546549:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.546559:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592637.546592:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f7cd02e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:3640:x1875475225908096:12345-0@lo:103: Request processed in 178us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.546599:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592637.546626:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee83c3d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225908096:0@lo:103: 00010000:00010000:3.0:1788592637.546680:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.546688:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.546693:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003031ef2e/0xbd314a3362db4902 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788592637.546708:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788592637.548822:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c0b2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:7442:x1875475225907328:12345-0@lo:253: Request processed in 20187us (20915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.548838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788592637.548924:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002eb288dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225907328:0@lo:253: 10000000:01000000:1.0:1788592637.548938:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788592637.548941:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788592637.548943:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788592637.548944:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592637.548954:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788592637.548956:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592637.548957:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592637.548958:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592637.548960:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788592637.548961:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592637.548963:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788592637.548979:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ed1f4e8a from lustre-MDT0001 10000000:01000000:1.0:1788592637.549050:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788592637.549054:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788592637.549060:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff921850ee4d40 local copy 10000000:01000000:1.0:1788592637.549063:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788592637.549121:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.549131:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.549139:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.549155:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908224:0@lo:101: 00000100:00100000:1.0:1788592637.549188:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.549219:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a30f114d going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.549736:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908224 00000100:00100000:3.0:1788592637.549742:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908224 00000100:00100000:3.0:1788592637.549786:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788592637.549794:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb44bdec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+9:7442:x1875475225908224:12345-0@lo:101: 00010000:00010000:3.0:1788592637.549806:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592637.549825:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de382f07/0xbd314a3362db4910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4909 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.549848:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de382f07/0xbd314a3362db4910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4909 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.549858:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de382f07/0xbd314a3362db4910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4909 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.549866:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de382f07, rc 0) 00000100:00100000:3.0:1788592637.549905:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb44bdec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:7442:x1875475225908224:12345-0@lo:101: Request processed in 112us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.549911:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592637.550013:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908224:0@lo:101: 00010000:00010000:2.0:1788592637.550026:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.550034:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592637.550157:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063294083 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908352:0@lo:501: 00000100:00100000:2.0:1788592637.550185:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592637.550201:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000332a06cb going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.550346:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908352 00000100:00100000:3.0:1788592637.550350:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908352 00000100:00100000:3.0:1788592637.550380:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592637.550387:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029dcc184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:7442:x1875475225908352:12345-0@lo:501: 00000100:00100000:3.0:1788592637.550447:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029dcc184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:7442:x1875475225908352:12345-0@lo:501: Request processed in 61us (261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592637.550453:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788592637.550508:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063294083 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908352:0@lo:501: 10000000:01000000:1.0:1788592637.550520:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788592637.550536:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788592637.550540:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550547:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550564:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550587:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788592637.550607:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff921875948800 10000000:01000000:1.0:1788592637.550611:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788592637.550616:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff921850ee4d40 10000000:01000000:1.0:1788592637.550619:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788592637.550621:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff921850ee4d40 from 1 10000000:01000000:1.0:1788592637.550624:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788592637.550641:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550647:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550654:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.550674:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908480:0@lo:101: 00000100:00100000:1.0:1788592637.550699:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.550712:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d966f8e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.550725:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908480 00000100:00100000:1.0:1788592637.550728:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908480 00000100:00100000:1.0:1788592637.550748:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592637.550753:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b83ed51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+10:7442:x1875475225908480:12345-0@lo:101: 00010000:00010000:1.0:1788592637.550761:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592637.550769:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca9d114f/0xbd314a3362db491e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4917 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550800:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca9d114f/0xbd314a3362db491e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4917 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550807:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca9d114f/0xbd314a3362db491e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4917 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550814:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca9d114f, rc 0) 00000100:00100000:1.0:1788592637.550839:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b83ed51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:7442:x1875475225908480:12345-0@lo:101: Request processed in 86us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.550844:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592637.550872:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908480:0@lo:101: 00010000:00010000:1.0:1788592637.550881:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550888:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.550901:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788592637.550908:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550915:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000d76cff35/0xbd314a3362db4917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.550922:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff921875948800 10000000:01000000:1.0:1788592637.550925:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788592637.550928:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff921875948800 from 1 10000000:01000000:1.0:1788592637.550934:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788592637.550947:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550953:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.550958:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.550968:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908608:0@lo:101: 00000100:00100000:1.0:1788592637.550989:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.551002:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d966f8e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.551019:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908608 00000100:00100000:1.0:1788592637.551022:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908608 00000100:00100000:1.0:1788592637.551037:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788592637.551042:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007386eb7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+11:7442:x1875475225908608:12345-0@lo:101: 00010000:00010000:1.0:1788592637.551048:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592637.551054:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7ab67ef/0xbd314a3362db492c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4925 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551087:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7ab67ef/0xbd314a3362db492c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4925 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551095:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7ab67ef/0xbd314a3362db492c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4925 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551101:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7ab67ef, rc 0) 00000100:00100000:1.0:1788592637.551125:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007386eb7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:7442:x1875475225908608:12345-0@lo:101: Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.551138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788592637.551165:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908608:0@lo:101: 00010000:00010000:1.0:1788592637.551174:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551181:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.551190:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788592637.551196:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551201:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000f5141fc5/0xbd314a3362db4925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.551207:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788592637.551210:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592637.551213:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff921875948800 10000000:01000000:1.0:1788592637.551215:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788592637.551217:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788592637.551219:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788592637.551229:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551304:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551311:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.551333:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908736:0@lo:101: 00000100:00100000:1.0:1788592637.551356:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.551367:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d966f8e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.551382:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908736 00000100:00100000:1.0:1788592637.551385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908736 00000100:00100000:1.0:1788592637.551400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592637.551404:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006810400c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:7442:x1875475225908736:12345-0@lo:101: 00010000:00010000:1.0:1788592637.551410:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592637.551415:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e9520114/0xbd314a3362db493a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4933 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551427:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9520114/0xbd314a3362db493a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4933 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551434:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e9520114/0xbd314a3362db493a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4933 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551440:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e9520114, rc 0) 00000100:00100000:1.0:1788592637.551465:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006810400c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225908736:12345-0@lo:101: Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.551470:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592637.551496:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908736:0@lo:101: 00010000:00010000:1.0:1788592637.551505:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.551511:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.551580:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908864:0@lo:501: 00000100:00100000:1.0:1788592637.551603:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.551614:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d966f8e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.551626:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908864 00000100:00100000:1.0:1788592637.551630:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908864 00000100:00100000:1.0:1788592637.551645:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592637.551649:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab44eb9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225908864:12345-0@lo:501: 00000100:00100000:1.0:1788592637.551749:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab44eb9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225908864:12345-0@lo:501: Request processed in 99us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.551755:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592637.551783:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908864:0@lo:501: 00000100:00100000:1.0:1788592637.551805:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908992:0@lo:503: 00000100:00100000:1.0:1788592637.551839:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.551851:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d966f8e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.551863:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225908992 00000100:00100000:1.0:1788592637.551867:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225908992 00000100:00100000:1.0:1788592637.551882:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592637.551887:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022fb462a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225908992:12345-0@lo:503: 00000100:00100000:1.0:1788592637.551959:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022fb462a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225908992:12345-0@lo:503: Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.551965:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592637.552002:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225908992:0@lo:503: 00000040:00080000:1.0:1788592637.552231:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788592637.552304:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225909120:0@lo:502: 00000100:00100000:1.0:1788592637.552344:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.552359:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d966f8e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.552373:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909120 00000100:00100000:1.0:1788592637.552376:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909120 00000100:00100000:1.0:1788592637.552393:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592637.552398:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d675f951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225909120:12345-0@lo:502: 00000100:00100000:1.0:1788592637.552477:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d675f951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225909120:12345-0@lo:502: Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.552483:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592637.552519:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225909120:0@lo:502: 00000040:00080000:1.0:1788592637.552693:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788592637.552717:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788592637.552731:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788592637.552743:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788592637.552756:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788592637.552768:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788592637.552781:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788592637.552795:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788592637.552808:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788592637.552823:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788592637.552838:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788592637.552852:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788592637.552868:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788592637.552881:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788592637.552896:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788592637.552910:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788592637.552922:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788592637.552935:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788592637.552948:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788592637.552960:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788592637.552984:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788592637.552998:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788592637.553011:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788592637.553031:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225909248:0@lo:502: 00000100:00100000:1.0:1788592637.553088:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.553104:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000005821a67f going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.553119:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909248 00000100:00100000:1.0:1788592637.553123:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909248 00000100:00100000:1.0:1788592637.553143:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592637.553149:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fccbf569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225909248:12345-0@lo:502: 00000100:00100000:1.0:1788592637.553214:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fccbf569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7442:x1875475225909248:12345-0@lo:502: Request processed in 66us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.553220:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592637.553256:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225909248:0@lo:502: 00000040:00080000:1.0:1788592637.553289:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788592637.553296:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:3.0:1788592637.553475:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592637.553481:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.553490:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013e8d2e9 already unused, calling callback (00000000800d70aa) 10000000:00010000:3.0:1788592637.553492:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.553500:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592637.553517:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592637.553522:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592637.553543:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.553549:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592637.553576:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.553582:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 0000000013e8d2e9/0xbd314a3362db4909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4910 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.553592:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592637.553594:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592637.553595:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592637.553678:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592637.553687:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225909376:0@lo:103: 00000100:00100000:3.0:1788592637.553716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.553747:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909376 00000100:00100000:3.0:1788592637.553750:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909376 00000100:00100000:3.0:1788592637.553778:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592637.553783:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b5832d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:3642:x1875475225909376:12345-0@lo:103: 00010000:00010000:3.0:1788592637.553791:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592637.553801:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de382f07/0xbd314a3362db4910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4909 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.553812:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592637.553840:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b5832d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:3642:x1875475225909376:12345-0@lo:103: Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.553846:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592637.553868:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225909376:0@lo:103: 00000020:01000000:1.0:1788592637.554870:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592637.554881:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.554883:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788592637.554888:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788592637.554891:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592637.554905:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004bb38892) 00000020:00000080:1.0:1788592637.554925:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788592637.554930:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788592637.554999:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788592637.555006:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db4948 00000020:00000080:1.0:1788592637.555593:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788592637.555599:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592637.555602:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.555603:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788592637.555615:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592637.555618:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.555620:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788592637.555622:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592637.555629:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000029db6d71) 00000020:00000080:1.0:1788592637.555640:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788592637.555643:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788592637.555645:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788592637.555647:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788592637.555653:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788592637.555721:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ed1f4e8a from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788592637.555733:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000e8f07a3a) 00000020:00000080:1.0:1788592637.555741:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788592637.555790:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788592637.555805:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db495d 00000020:00000080:1.0:1788592637.555890:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788592637.555896:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788592637.555901:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbd314a3362db4964 00080000:01000000:1.0:1788592637.555907:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788592637.555910:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db496b 00080000:10000000:1.0:1788592637.556653:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788592637.556790:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 10000000:01000000:1.0:1788592637.604151:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788592637.604159:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921846c66000 from 21 10000000:01000000:1.0:1788592637.604164:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788592637.604206:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.604217:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.604226:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.604320:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225909504:0@lo:101: 00000100:00100000:1.0:1788592637.604383:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.604449:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077cbf5c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.604526:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909504 00000100:00100000:2.0:1788592637.604533:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909504 00000100:00100000:2.0:1788592637.604577:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788592637.604584:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e81017b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+12:6509:x1875475225909504:12345-0@lo:101: 00010000:00010000:2.0:1788592637.604595:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592637.604606:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d666d10/0xbd314a3362db4979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4972 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.604627:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d666d10/0xbd314a3362db4979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4972 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.604636:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d666d10/0xbd314a3362db4979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4972 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.604643:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d666d10, rc 0) 00000100:00100000:2.0:1788592637.604700:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e81017b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:6509:x1875475225909504:12345-0@lo:101: Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.604707:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592637.604792:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225909504:0@lo:101: 00010000:00010000:1.0:1788592637.604805:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.604812:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.604863:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225909632:0@lo:501: 00000100:00100000:1.0:1788592637.604886:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.604905:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077cbf5c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.604964:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909632 00000100:00100000:3.0:1788592637.604969:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909632 00000100:00100000:3.0:1788592637.605000:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592637.605005:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f299db32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:6509:x1875475225909632:12345-0@lo:501: 00000100:00100000:3.0:1788592637.605128:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f299db32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:6509:x1875475225909632:12345-0@lo:501: Request processed in 123us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.605135:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592637.605158:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be006b75 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225909632:0@lo:501: 00000100:00100000:3.0:1788592637.605182:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225909760:0@lo:503: 00000100:00100000:3.0:1788592637.605218:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.605226:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000008160874b going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.605326:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909760 00000100:00100000:1.0:1788592637.605330:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909760 00000100:00100000:1.0:1788592637.605349:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592637.605353:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2c17789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:6509:x1875475225909760:12345-0@lo:503: 00000100:00100000:1.0:1788592637.608360:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2c17789 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:6509:x1875475225909760:12345-0@lo:503: Request processed in 2997us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.608375:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592637.609530:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225909760:0@lo:503: 00000100:00100000:2.0:1788592637.611477:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2958d56 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7455:1875475225909888:0@lo:502: 00000100:00100000:2.0:1788592637.611552:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592637.611605:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca5ba59c going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.611703:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225909888 00000100:00100000:3.0:1788592637.611710:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225909888 00000100:00100000:3.0:1788592637.611754:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788592637.611761:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003246d84a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7455:x1875475225909888:12345-0@lo:502: 00000100:00100000:3.0:1788592637.611886:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003246d84a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7455:x1875475225909888:12345-0@lo:502: Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.611895:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788592637.611986:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2958d56 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7455:1875475225909888:0@lo:502: 00000100:00100000:1.0:1788592637.612028:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008cbbca96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7455:1875475225910016:0@lo:502: 00000100:00100000:1.0:1788592637.612059:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.612092:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000866c1432 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.612144:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910016 00000100:00100000:3.0:1788592637.612148:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910016 00000100:00100000:3.0:1788592637.615362:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592637.615387:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d655bba2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7455:x1875475225910016:12345-0@lo:502: 00000100:00100000:3.0:1788592637.615542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d655bba2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:7455:x1875475225910016:12345-0@lo:502: Request processed in 161us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.615550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788592637.616359:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008cbbca96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7455:1875475225910016:0@lo:502: 00000040:00080000:1.0:1788592637.616400:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788592637.619362:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788592637.619397:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788592637.619406:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.619419:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000009d545a20/0xbd314a3362db4972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592637.619430:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788592637.619432:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788592637.619435:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788592637.619471:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.619479:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.619488:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.619510:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225910144:0@lo:101: 00000100:00100000:3.0:1788592637.619573:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.619655:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df867515 going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.621348:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910144 00000100:00100000:2.0:1788592637.621361:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910144 00000100:00100000:2.0:1788592637.621408:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592637.621424:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0316a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:6509:x1875475225910144:12345-0@lo:101: 00010000:00010000:2.0:1788592637.621440:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592637.621454:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a08bef1/0xbd314a3362db4987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4980 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.621490:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a08bef1/0xbd314a3362db4987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4980 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.621500:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a08bef1/0xbd314a3362db4987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4980 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.621509:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a08bef1, rc 0) 00000100:00100000:2.0:1788592637.621567:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0316a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225910144:12345-0@lo:101: Request processed in 144us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.621574:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592637.621937:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225910144:0@lo:101: 00010000:00010000:3.0:1788592637.621956:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.621972:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.622037:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225910272:0@lo:501: 00000100:00100000:3.0:1788592637.622092:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.622127:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df867515 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.622142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910272 00000100:00100000:3.0:1788592637.622146:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910272 00000100:00100000:3.0:1788592637.622166:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592637.622172:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003170286e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225910272:12345-0@lo:501: 00000100:00100000:3.0:1788592637.622348:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003170286e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225910272:12345-0@lo:501: Request processed in 176us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.622355:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592637.622388:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225910272:0@lo:501: 00000100:00100000:3.0:1788592637.622414:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225910400:0@lo:503: 00000100:00100000:3.0:1788592637.622451:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.622463:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df911276 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.622474:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910400 00000100:00100000:3.0:1788592637.622477:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910400 00000100:00100000:3.0:1788592637.622494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592637.622498:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b9f391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225910400:12345-0@lo:503: 00000100:00100000:3.0:1788592637.622568:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b9f391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225910400:12345-0@lo:503: Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.622574:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592637.622610:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225910400:0@lo:503: 00000100:00100000:3.0:1788592637.622826:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7456:1875475225910528:0@lo:502: 00000100:00100000:3.0:1788592637.622856:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.622872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910528 00000100:00100000:3.0:1788592637.622875:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910528 00000100:00100000:3.0:1788592637.622890:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592637.622895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089b3ba0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:7456:x1875475225910528:12345-0@lo:502: 00000100:00100000:3.0:1788592637.622956:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089b3ba0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:7456:x1875475225910528:12345-0@lo:502: Request processed in 60us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.622963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592637.622985:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c5304f7 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.622995:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7456:1875475225910528:0@lo:502: 00000020:01000000:3.0:1788592637.623012:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592637.623021:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592637.623023:0:7456:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788592637.623027:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788592637.623030:0:7456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:3.0:1788592637.623057:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592637.623090:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000004780405f) 00000020:00000080:3.0:1788592637.623107:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788592637.623112:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788592637.623168:0:7456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788592637.623172:0:7456:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788592637.623177:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4995 00010000:00080000:3.0:1788592637.623202:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000020b94d32@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592637.629181:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00010000:00010000:0.0:1788592637.633793:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788592637.634043:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788592637.636820:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788592637.637169:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788592637.639652:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788592637.639677:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788592637.639716:0:7456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788592637.639738:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db499c 00000100:00080000:1.0:1788592637.639747:0:7456:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788592637.639752:0:7456:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000020b94d32 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592637.639784:0:7456:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008cbbca96 x1875475225910656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592637.639840:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008cbbca96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225910656:0@lo:38: 00000100:00100000:0.0:1788592637.639903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.640003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910656 00000100:00100000:1.0:1788592637.640010:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910656 00000100:00100000:1.0:1788592637.640038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592637.640044:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000214559dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475225910656:12345-0@lo:38: 00010000:02000000:1.0:1788592637.640057:0:6517:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:1.0:1788592637.652040:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000214559dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475225910656:12345-0@lo:38: Request processed in 11987us (12129us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788592637.652055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788592637.652237:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788592637.652300:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788592637.652709:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000020b94d32 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592637.652715:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592637.652719:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008cbbca96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225910656:0@lo:38: 00000020:00000080:2.0:1788592637.652906:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788592637.652916:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592637.652922:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592637.652924:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788592637.652928:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592637.652932:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592637.652934:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788592637.652936:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592637.652940:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:2.0:1788592637.652960:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592637.652984:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000f09016c0) 00000020:00000080:2.0:1788592637.653006:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:2.0:1788592637.653019:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592637.653153:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788592637.653159:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788592637.653165:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db49aa 00010000:00080000:2.0:1788592637.653190:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002a3f6fc0@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592637.655377:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:1.0:1788592637.656698:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788592637.656712:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788592637.656743:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788592637.656762:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db49b1 00000100:00080000:1.0:1788592637.656771:0:7454:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788592637.656775:0:7454:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000002a3f6fc0 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592637.656808:0:7454:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000900ce21a x1875475225910784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592637.656867:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000900ce21a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475225910784:0@lo:38: 00000100:00100000:0.0:1788592637.656937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592637.657116:0:7461:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@0000000028f2c406 x1875475225910912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592637.657126:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 0 seconds 00000100:00080000:1.0:1788592637.657174:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788592637.657246:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592637.657249:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657251:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788592637.657254:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788592637.657256:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788592637.657258:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788592637.657259:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788592637.657260:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788592637.657262:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657263:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788592637.657264:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592637.657267:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657268:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788592637.657271:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788592637.657298:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788592637.657308:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592637.657310:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657312:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788592637.657314:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592637.657316:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657317:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788592637.657319:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788592637.657321:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788592637.657345:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592637.657347:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657349:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788592637.657351:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1788592637.657399:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788592637.657426:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788592637.657433:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.657444:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000007f232b3c/0xbd314a3362db4933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.657457:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921875948800 from 1 10000000:01000000:1.0:1788592637.657459:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788592637.657480:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.657486:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.657494:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.657504:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc97e6b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911040:0@lo:101: 00000100:00100000:1.0:1788592637.657534:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.657555:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dcb3536 going to sleep for 11 seconds 00000020:01000000:1.0:1788592637.657767:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592637.657770:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657772:0:7456:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788592637.657774:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592637.657777:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592637.657778:0:7456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788592637.657780:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788592637.657781:0:7456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788592637.657798:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8ff7839 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7456:1875475225911168:0@lo:502: 00000100:00100000:1.0:1788592637.657833:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.657862:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911040 00000100:00100000:1.0:1788592637.657868:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911040 00000100:00100000:1.0:1788592637.657899:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911168 00000100:00100000:1.0:1788592637.657902:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911168 00000100:00100000:1.0:1788592637.657915:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592637.657922:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a36b9f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:7442:x1875475225911040:12345-0@lo:101: 00010000:00010000:1.0:1788592637.657941:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592637.657954:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db49b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.657976:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.657985:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.657993:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029e55456, rc 0) 00000100:00100000:1.0:1788592637.658025:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a36b9f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7442:x1875475225911040:12345-0@lo:101: Request processed in 103us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.658031:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592637.658053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788592637.658059:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027ba6581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:7456:x1875475225911168:12345-0@lo:502: 00000100:00100000:1.0:1788592637.658152:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027ba6581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:7456:x1875475225911168:12345-0@lo:502: Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.658159:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788592637.658202:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc97e6b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911040:0@lo:101: 00010000:00010000:1.0:1788592637.658214:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.658223:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.660162:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc97e6b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911296:0@lo:256: 00000100:00100000:2.0:1788592637.660689:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e602c68 going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.660712:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8ff7839 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7456:1875475225911168:0@lo:502: 00000020:01000000:2.0:1788592637.660742:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592637.660748:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592637.660751:0:7456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788592637.660754:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788592637.660970:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788592637.660993:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788592637.661000:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.661013:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000de382f07/0xbd314a3362db4980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592637.661022:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788592637.661024:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff921850ee4d40 from 1 10000000:01000000:3.0:1788592637.661026:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788592637.661049:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.661055:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.661062:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.661135:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225911424:0@lo:101: 00000100:00100000:3.0:1788592637.661169:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.661228:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000004da1cb70 going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.661650:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.662059:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f57a9a3e going to sleep for 11 seconds 00000100:00100000:1.0:1788592637.662111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910784 00000100:00100000:1.0:1788592637.662118:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910784 00000100:00100000:1.0:1788592637.662144:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592637.662150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fc30e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875475225910784:12345-0@lo:38: 00010000:00080000:1.0:1788592637.662172:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1788592637.662205:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db49cd 00000004:00100000:1.0:1788592637.662218:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788592637.662223:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788592637.662688:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911424 00000100:00100000:2.0:1788592637.662694:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911424 00000100:00100000:2.0:1788592637.662734:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911296 00000100:00100000:2.0:1788592637.662737:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911296 00000100:00100000:2.0:1788592637.662751:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592637.662756:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a227421c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225911424:12345-0@lo:101: 00010000:00010000:2.0:1788592637.662768:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592637.662779:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000648398d9/0xbd314a3362db49d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db49c6 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.662801:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000648398d9/0xbd314a3362db49d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.662812:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000648398d9/0xbd314a3362db49d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.662833:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000648398d9, rc 0) 00000100:00100000:2.0:1788592637.662891:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a227421c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225911424:12345-0@lo:101: Request processed in 134us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.662898:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592637.662925:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592637.662931:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e75119d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7442:x1875475225911296:12345-0@lo:256: 20000000:01000000:2.0:1788592637.662944:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788592637.662958:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788592637.662962:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788592637.663035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e75119d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7442:x1875475225911296:12345-0@lo:256: Request processed in 104us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.663042:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788592637.663145:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000850aa2ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225911424:0@lo:101: 00010000:00010000:0.0:1788592637.663161:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.663169:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592637.663244:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c693e287 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225911552:0@lo:501: 00000100:00100000:0.0:1788592637.663273:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.663299:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049399f3f going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.663391:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911552 00000100:00100000:2.0:1788592637.663395:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911552 00000100:00100000:2.0:1788592637.663411:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592637.663414:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008af18a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225911552:12345-0@lo:501: 00000100:00100000:2.0:1788592637.663477:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008af18a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225911552:12345-0@lo:501: Request processed in 62us (204us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592637.663484:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788592637.663539:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c693e287 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225911552:0@lo:501: 10000000:01000000:0.0:1788592637.663573:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788592637.663578:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.663585:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000003031ef2e/0xbd314a3362db49c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.663717:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc97e6b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911296:0@lo:256: 10000000:01000000:1.0:1788592637.664417:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592637.664426:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.664434:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592637.664441:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921875948800 from 1 10000000:01000000:1.0:1788592637.664444:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592637.664467:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.664473:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592637.664480:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592637.664506:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc97e6b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911680:0@lo:101: 00000100:00100000:1.0:1788592637.664542:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.664730:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f57a9a3e going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.664783:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911680 00000100:00100000:3.0:1788592637.664788:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911680 00000100:00100000:2.0:1788592637.664830:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592637.664839:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002433eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7442:x1875475225911680:12345-0@lo:101: 00010000:00010000:2.0:1788592637.664848:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592637.664858:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db49db expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.664876:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db49db expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.664891:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49db expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.664899:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e3ee70e, rc 0) 00000100:00100000:2.0:1788592637.664940:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002433eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:7442:x1875475225911680:12345-0@lo:101: Request processed in 103us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.664946:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592637.665025:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc97e6b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911680:0@lo:101: 00010000:00010000:0.0:1788592637.665037:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.665044:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592637.665151:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c693e287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911808:0@lo:501: 00000100:00100000:0.0:1788592637.665177:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.665192:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049399f3f going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.665325:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911808 00000100:00100000:2.0:1788592637.665329:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911808 00000100:00100000:2.0:1788592637.665348:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592637.665353:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003be7fda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:7442:x1875475225911808:12345-0@lo:501: 00000100:00100000:2.0:1788592637.665441:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003be7fda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:7442:x1875475225911808:12345-0@lo:501: Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.665456:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788592637.665636:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c693e287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911808:0@lo:501: 00000100:00100000:0.0:1788592637.665831:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c693e287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911936:0@lo:503: 00000100:00100000:0.0:1788592637.665874:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.665937:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049399f3f going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.666609:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225911936 00000100:00100000:3.0:1788592637.666615:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225911936 00000100:00100000:3.0:1788592637.666639:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788592637.666645:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034dc485e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:7442:x1875475225911936:12345-0@lo:503: 00000040:00080000:3.0:1788592637.666693:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592637.666747:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034dc485e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:7442:x1875475225911936:12345-0@lo:503: Request processed in 103us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.666764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592637.666913:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c693e287 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225911936:0@lo:503: 00000040:00080000:0.0:1788592637.667182:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592637.667256:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788592637.667337:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788592637.668870:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000b5437b1a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592637.668969:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fc30e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875475225910784:12345-0@lo:38: Request processed in 6810us (12023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.668984:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592637.669768:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592637.669778:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788592637.669784:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788592637.669789:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788592637.669791:0:3638:0:(import.c:65:import_set_state_nolock()) 000000002a3f6fc0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788592637.669810:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000900ce21a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475225910784:0@lo:38: 00000100:00100000:0.0:1788592637.669936:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a8e381 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225912064:0@lo:41: 00000100:00100000:0.0:1788592637.669973:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.670020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912064 00000100:00100000:0.0:1788592637.670026:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912064 00000100:00100000:0.0:1788592637.670083:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592637.670091:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c693e287 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875475225912064:12345-0@lo:41: 00000004:00000024:0.0:1788592637.670116:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788592637.670153:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c693e287 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875475225912064:12345-0@lo:41: Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592637.670159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592637.670185:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a8e381 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225912064:0@lo:41: 00000040:00080000:2.0:1788592637.670968:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788592637.671147:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788592637.671177:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592637.671198:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.671209:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592637.671421:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788592637.671424:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff921875948800 10000000:01000000:0.0:1788592637.671427:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff921875948800 10000000:01000000:0.0:1788592637.671431:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592637.671437:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921875948800 from 1 10000000:01000000:0.0:1788592637.671439:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592637.671473:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.671486:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.671494:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592637.671512:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912192:0@lo:101: 00000100:00100000:0.0:1788592637.671555:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.671610:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96bb8a going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.671683:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912192 00000100:00100000:3.0:1788592637.671689:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912192 00000100:00100000:3.0:1788592637.671732:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592637.671739:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002aaac2ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:7442:x1875475225912192:12345-0@lo:101: 00010000:00010000:3.0:1788592637.671753:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592637.671764:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e720a694/0xbd314a3362db49f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db49e9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.671785:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e720a694/0xbd314a3362db49f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.671795:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e720a694/0xbd314a3362db49f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.671804:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e720a694, rc 0) 00000100:00100000:3.0:1788592637.671920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002aaac2ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912192:12345-0@lo:101: Request processed in 181us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.671927:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788592637.672530:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912192:0@lo:101: 00010000:00010000:0.0:1788592637.672548:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.672557:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592637.672656:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912320:0@lo:501: 00000100:00100000:0.0:1788592637.672699:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.672774:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96bb8a going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.672824:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912320 00000100:00100000:2.0:1788592637.672830:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912320 00000100:00100000:2.0:1788592637.672894:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788592637.672903:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090288998 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912320:12345-0@lo:501: 00000100:00100000:2.0:1788592637.673027:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090288998 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912320:12345-0@lo:501: Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.673035:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592637.673107:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912320:0@lo:501: 00000100:00100000:0.0:1788592637.673132:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912448:0@lo:503: 00000100:00100000:0.0:1788592637.673169:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.673652:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96bb8a going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.673730:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912448 00000100:00100000:3.0:1788592637.673735:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912448 00000100:00100000:3.0:1788592637.673760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592637.673766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013368364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912448:12345-0@lo:503: 00000100:00100000:3.0:1788592637.673859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013368364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912448:12345-0@lo:503: Request processed in 93us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.673866:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592637.673941:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912448:0@lo:503: 00000040:00080000:0.0:1788592637.674207:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592637.674301:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912576:0@lo:502: 00000100:00100000:0.0:1788592637.674335:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.674351:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96bb8a going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.674475:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912576 00000100:00100000:3.0:1788592637.674480:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912576 00000100:00100000:3.0:1788592637.674499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788592637.674504:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018a3676c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912576:12345-0@lo:502: 00000100:00100000:3.0:1788592637.674586:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018a3676c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912576:12345-0@lo:502: Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.674593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788592637.674680:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912576:0@lo:502: 00000040:00080000:0.0:1788592637.674850:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788592637.674876:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788592637.674892:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788592637.674906:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788592637.674918:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788592637.674932:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788592637.674946:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788592637.674960:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788592637.674973:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788592637.674984:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788592637.674995:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788592637.675007:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788592637.675021:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788592637.675033:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788592637.675057:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788592637.675106:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788592637.675123:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788592637.675136:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788592637.675158:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788592637.675171:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788592637.675184:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788592637.675196:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788592637.675208:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788592637.675220:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788592637.675307:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788592637.675327:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788592637.675340:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788592637.675352:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788592637.675377:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912704:0@lo:502: 00000100:00100000:0.0:1788592637.675415:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.675445:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96bb8a going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.675526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912704 00000100:00100000:2.0:1788592637.675533:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912704 00000100:00100000:2.0:1788592637.675561:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788592637.675567:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee84d23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912704:12345-0@lo:502: 00000100:00100000:2.0:1788592637.675655:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee84d23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912704:12345-0@lo:502: Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.675675:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592637.675810:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912704:0@lo:502: 00000040:00080000:0.0:1788592637.675846:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788592637.675854:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788592637.676782:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788592637.676803:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c6a7473d) 00000020:00000080:3.0:1788592637.676823:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:3.0:1788592637.676905:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ed1f4e8a from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788592637.676908:0:7465:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ed1f4e8a from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788592637.676911:0:7465:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ed1f4e8a 3 00010000:00080000:3.0:1788592637.676946:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000071c4bf3b@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592637.679860:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:3.0:1788592637.680321:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788592637.680367:0:7465:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788592637.680381:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbd314a3362db49fe 00000100:00080000:3.0:1788592637.680393:0:7465:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592637.680398:0:7465:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000071c4bf3b using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592637.680436:0:7465:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000134dc183 x1875475225912832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592637.680490:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000134dc183 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475225912832:0@lo:38: 00000100:00100000:2.0:1788592637.680558:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.680641:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912832 00000100:00100000:1.0:1788592637.680649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912832 00000100:00100000:1.0:1788592637.680694:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592637.680700:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073d531c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475225912832:12345-0@lo:38: 00010000:00080000:1.0:1788592637.680722:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1788592637.680753:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbd314a3362db4a05 00000004:00100000:1.0:1788592637.680765:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788592637.680791:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000770fe14d : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788592637.680846:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788592637.687506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073d531c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875475225912832:12345-0@lo:38: Request processed in 6800us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.687521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788592637.687678:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000134dc183 x1875475225912832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592637.687690:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592637.687701:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788592637.687709:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788592637.687714:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788592637.687717:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000071c4bf3b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788592637.687723:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000134dc183 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475225912832:0@lo:38: 00000040:00080000:3.0:1788592637.687898:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788592637.688018:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788592637.688049:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592637.688100:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592637.688110:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 000000005cfe4ebf/0xbd314a3362db49e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592637.688167:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592637.688170:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592637.688171:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592637.688173:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592637.688174:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592637.688175:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592637.688177:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592637.688178:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592637.688185:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592637.688186:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592637.688187:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592637.688190:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788592637.688193:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592637.688194:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592637.688195:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592637.688196:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592637.688196:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592637.688197:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592637.688198:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592637.688199:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592637.688200:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592637.688200:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592637.688201:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592637.688222:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788592637.688715:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912960:0@lo:253: 00000100:00100000:0.0:1788592637.688780:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.688820:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018e148a4 going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.688868:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225912960 00000100:00100000:2.0:1788592637.688875:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225912960 00000100:00100000:2.0:1788592637.688925:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788592637.688934:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058db2e07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912960:12345-0@lo:253: 20000000:01000000:2.0:1788592637.688960:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788592637.688973:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788592637.690305:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788592637.690446:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788592637.690461:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788592637.690614:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592637.690628:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592637.690647:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.690683:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.690690:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.690695:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.690727:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.690739:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 18 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.690761:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bd4c3d2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225913088:0@lo:104: 00000100:00100000:3.0:1788592637.690811:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592637.690846:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.690854:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 18 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.690862:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225913216:0@lo:104: 00000100:00100000:3.0:1788592637.690881:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.690896:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c70bc921 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.690919:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913088 00000100:00100000:3.0:1788592637.690923:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913088 00000100:00100000:3.0:1788592637.690949:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913216 00000100:00100000:3.0:1788592637.690957:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913216 00000100:00100000:3.0:1788592637.690972:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592637.690978:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000396b47c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6528:x1875475225913088:12345-0@lo:104: 00010000:00010000:3.0:1788592637.690988:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691033:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592637.691037:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000396b47c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6528:x1875475225913088:12345-0@lo:104: Request processed in 61us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.691044:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592637.691058:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592637.691063:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023fe5546 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225913216:12345-0@lo:104: 00010000:00010000:3.0:1788592637.691096:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691128:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592637.691132:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023fe5546 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225913216:12345-0@lo:104: Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.691138:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788592637.691151:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592637.691155:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691162:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7276cad already unused, calling callback (00000000800d70aa) 10000000:00010000:3.0:1788592637.691164:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691171:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592637.691186:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592637.691191:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592637.691214:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691220:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592637.691356:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691363:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 00000000f7276cad/0xbd314a3362db49b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49bf expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691373:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592637.691374:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691380:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000651deaf already unused, calling callback (00000000800d70aa) 10000000:00010000:3.0:1788592637.691382:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691387:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592637.691393:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592637.691397:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592637.691418:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691424:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592637.691429:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691434:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 000000000651deaf/0xbd314a3362db48e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.691445:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592637.691447:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592637.691448:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592637.691454:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592637.691480:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bd4c3d2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225913088:0@lo:104: 00000100:00100000:3.0:1788592637.691488:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225913216:0@lo:104: 00010000:00010000:3.0:1788592637.691505:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592637.691716:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058db2e07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7442:x1875475225912960:12345-0@lo:253: Request processed in 2785us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.691724:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788592637.691818:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7442:1875475225912960:0@lo:253: 10000000:01000000:0.0:1788592637.691827:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788592637.691830:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592637.691832:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592637.691833:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592637.691834:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592637.691836:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592637.691837:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592637.691838:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592637.691839:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592637.691841:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592637.691842:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592637.691843:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788592637.691851:0:7442:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788592637.693778:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf1a10d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225913344:0@lo:103: 00000100:00100000:1.0:1788592637.693839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.693921:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592637.693927:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d78b0b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225913472:0@lo:103: 00000100:00100000:1.0:1788592637.693974:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788592637.697524:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788592637.697747:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788592637.697987:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788592637.698393:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788592637.698579:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 40000000:00080000:1.0:1788592637.698841:0:7466:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00080000:10000000:0.0:1788592637.699186:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788592637.699985:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00000100:00100000:2.0:1788592637.700485:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913344 00000100:00100000:2.0:1788592637.700496:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913344 00010000:00010000:2.0:1788592637.700531:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 18 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592637.700573:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913472 00000100:00100000:2.0:1788592637.700583:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913472 00010000:00010000:2.0:1788592637.700596:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 19 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592637.700613:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592637.700631:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff0a6abc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3639:x1875475225913344:12345-0@lo:103: 00010000:00010000:2.0:1788592637.700644:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592637.700648:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 19 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700659:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 19 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700683:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000029e55456/0xbd314a3362db49bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db49b8 expref: 19 pid: 6504 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700695:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592637.700764:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff0a6abc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3639:x1875475225913344:12345-0@lo:103: Request processed in 134us (6926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.700771:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592637.700787:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592637.700793:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001287d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:3639:x1875475225913472:12345-0@lo:103: 00010000:00010000:2.0:1788592637.700800:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592637.700804:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 17 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700811:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 17 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700836:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069052dc7/0xbd314a3362db48ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db48e6 expref: 17 pid: 6507 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700852:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700860:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592637.700874:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013569569s 00010000:00010000:2.0:1788592637.700878:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700885:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700891:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700897:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700902:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb0c4924 already unused, calling callback (00000000e5ac922e) 00010000:00010000:2.0:1788592637.700906:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700913:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700928:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592637.700939:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592637.700968:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001287d8e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3639:x1875475225913472:12345-0@lo:103: Request processed in 176us (6995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592637.700975:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592637.701244:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d78b0b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225913472:0@lo:103: 00000100:00100000:1.0:1788592637.701255:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf1a10d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225913344:0@lo:103: 00010000:00010000:3.0:1788592637.701404:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.701412:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592637.701417:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788592637.701558:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788592637.701911:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788592637.702541:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788592637.702802:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788592637.703004:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788592637.704425:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788592637.704794:0:7471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788592637.704840:0:7471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875475225913600:0@lo:700: 00000100:00100000:0.0:1788592637.704903:0:7471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.704943:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913600 00000100:00100000:0.0:1788592637.704949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913600 00000100:00100000:0.0:1788592637.704987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592637.704995:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000388aa638 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1875475225913600:12345-0@lo:700: 00000100:00100000:0.0:1788592637.705159:0:7471:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d939caef going to sleep for 11 seconds 00000040:01000000:1.0:1788592637.705273:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788592637.705615:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225913728:0@lo:1000: 00000100:00100000:1.0:1788592637.705678:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592637.705734:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 000000005821a67f going to sleep for 11 seconds 00000040:01000000:0.0:1788592637.706146:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788592637.706316:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788592637.706844:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788592637.706852:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788592637.706972:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788592637.707144:0:7470:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788592637.707149:0:7470:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788592637.708327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913728 00000100:00100000:3.0:1788592637.708337:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913728 00000100:00100000:3.0:1788592637.708382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592637.708390:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000758440fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225913728:12345-0@lo:1000: 00000100:00100000:3.0:1788592637.708489:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000758440fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225913728:12345-0@lo:1000: Request processed in 100us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.708498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592637.709207:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225913728:0@lo:1000: 00000040:01000000:1.0:1788592637.709586:0:7472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788592637.711156:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225913856:0@lo:700: 40000000:02000000:1.0:1788592637.711183:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788592637.711799:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592637.711841:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 000000007761ce30 going to sleep for 11 seconds 00000040:00080000:0.0:1788592637.713144:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788592637.713227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913856 00000100:00100000:0.0:1788592637.713235:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913856 00000100:00100000:0.0:1788592637.713283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592637.713292:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fc42dfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225913856:12345-0@lo:700: 00000100:00100000:0.0:1788592637.713367:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fc42dfa pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225913856:12345-0@lo:700: Request processed in 77us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592637.713385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1788592637.716020:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:0.0:1788592637.716152:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225913856:0@lo:700: 00000100:00100000:0.0:1788592637.716509:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000093cbfd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1875475225913984:0@lo:900: 00000100:00100000:0.0:1788592637.716565:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592637.716659:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2164d04 going to sleep for 11 seconds 00000040:01000000:0.0:1788592637.716694:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788592637.716921:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788592637.717155:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788592637.717782:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788592637.717948:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788592637.718124:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788592637.718257:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788592637.718405:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788592637.718537:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788592637.718751:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788592637.718887:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:1.0:1788592637.723394:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000388aa638 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1875475225913600:12345-0@lo:700: Request processed in 18392us (18484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592637.723413:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788592637.723563:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee5fd30f x1875475225913600/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788592653 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592637.723578:0:7471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee5fd30f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875475225913600:0@lo:700: 40000000:02000000:2.0:1788592637.723591:0:7471:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788592637.727356:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788592637.727767:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788592637.727920:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788592637.728105:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788592637.728264:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788592637.728397:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788592637.728546:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788592637.728708:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788592637.729028:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788592637.729192:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788592637.729331:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788592637.729479:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788592637.729622:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788592637.729761:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788592637.729909:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788592637.730091:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788592637.730234:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788592637.730365:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788592637.730505:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:3.0:1788592637.733048:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225913984 00000100:00100000:3.0:1788592637.733084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225913984 00000100:00100000:3.0:1788592637.733147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592637.733155:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004830873e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7472:x1875475225913984:12345-0@lo:900: 00000100:00100000:3.0:1788592637.733245:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004830873e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7472:x1875475225913984:12345-0@lo:900: Request processed in 90us (16680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.733268:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788592637.733320:0:7472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000093cbfd3 x1875475225913984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788592653 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592637.733333:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000093cbfd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1875475225913984:0@lo:900: 00000100:00100000:3.0:1788592637.733458:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225914112:0@lo:1000: 00000100:00100000:3.0:1788592637.733505:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.733532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225914112 00000100:00100000:3.0:1788592637.733535:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225914112 00000100:00100000:3.0:1788592637.733557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592637.733562:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd4c3d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225914112:12345-0@lo:1000: 00000100:00100000:3.0:1788592637.733614:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd4c3d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225914112:12345-0@lo:1000: Request processed in 52us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592637.733713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592637.733744:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065cdad29 going to sleep for 11 seconds 00000100:00100000:3.0:1788592637.733757:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225914112:0@lo:1000: 00000004:00080000:3.0:1788592637.733796:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000005802ffaf with version 0 00000020:00100000:3.0:1788592637.733810:0:7472:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788592637.733814:0:7472:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000046683090 x1875475225914368/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788592637.733826:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225914368:0@lo:1000: 00000100:00100000:3.0:1788592637.733849:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.733867:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225914368 00000100:00100000:3.0:1788592637.733870:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225914368 00000100:00100000:3.0:1788592637.733890:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592637.733895:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ddfc6d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225914368:12345-0@lo:1000: 00000100:00100000:3.0:1788592637.734199:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065cdad29 going to sleep for 11 seconds 00100000:10000000:0.0:1788592637.736601:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788592637.739877:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788592637.740089:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788592637.740221:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788592637.740389:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788592637.740573:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788592637.743631:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1788592637.744062:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ddfc6d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225914368:12345-0@lo:1000: Request processed in 10163us (10209us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788592637.744114:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:3.0:1788592637.744353:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788592637.744358:0:7472:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788592637.744372:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225914368:0@lo:1000: 00000100:00100000:3.0:1788592637.744451:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225914496:0@lo:1000: 00000100:00100000:3.0:1788592637.744488:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592637.744567:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000988baa2 going to sleep for 11 seconds 00000100:00100000:0.0:1788592637.744697:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225914496 00000100:00100000:0.0:1788592637.744704:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225914496 00000100:00100000:0.0:1788592637.744779:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592637.744787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf1a10d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225914496:12345-0@lo:1000: 00000100:00100000:0.0:1788592637.744853:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf1a10d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875475225914496:12345-0@lo:1000: Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592637.744860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592637.744912:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046683090 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875475225914496:0@lo:1000: 00000040:00080000:3.0:1788592637.744928:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788592637.744953:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000065cdad29 with version 1 00000004:00080000:1.0:1788592637.748742:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000082cfb28a version 1 rpc_version 1 00000020:00100000:1.0:1788592637.748791:0:7462:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788592637.748801:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002bd89330 x1875475225914752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592637.748824:0:7462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1875475225914752:0@lo:1000: 00000100:00100000:1.0:1788592637.748890:0:7462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788592637.749306:0:7472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788592637.749383:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788592637.749658:0:7462:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014034e2c going to sleep for 11 seconds 00000100:00100000:2.0:1788592637.749810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225914752 00000100:00100000:2.0:1788592637.749819:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225914752 00000100:00100000:2.0:1788592637.749859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592637.749866:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d04b3305 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875475225914752:12345-0@lo:1000: 00000001:00080000:2.0:1788592637.752336:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788592637.752458:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d04b3305 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875475225914752:12345-0@lo:1000: Request processed in 2589us (3566us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788592637.752470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1788592637.752727:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788592637.752732:0:7462:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788592637.752751:0:7462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1875475225914752:0@lo:1000: 00000001:00080000:0.0:1788592637.755058:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788592637.755137:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb76c819ff988 00100000:10000000:0.0:1788592637.755153:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788592637.756010:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788592637.756044:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788592637.756306:0:7442:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788592637.756334:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788592637.759316:0:7442:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592637.759513:0:7442:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788592637.760401:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592637.769775:0:7471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788592637.769847:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788592637.769852:0:7471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788592637.888165:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592638.713161:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 0 seconds 00010000:00010000:3.0:1788592638.909712:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592639.737813:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 0 seconds 00010000:00010000:1.0:1788592639.928281:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592640.762875:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 0 seconds 00010000:00010000:3.0:1788592640.952351:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592641.784479:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 0 seconds 00010000:00010000:1.0:1788592641.979254:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592641.986500:0:7716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788592642.733593:0:7768:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592642.733829:0:7768:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788592642.808190:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 0 seconds 00000100:00080000:1.0:1788592642.873172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788592642.873181:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788592642.873184:0:36:0:(import.c:65:import_set_state_nolock()) 0000000020b94d32 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592642.873193:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 171 00000100:00080000:1.0:1788592642.873198:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788592642.873203:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000020b94d32 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592642.873233:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c71c76f6 x1875475225915136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592642.873311:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225914880:0@lo:400: 00000100:00100000:1.0:1788592642.873376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592642.873583:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592642.873590:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005abf4030 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225915008:0@lo:400: 00000100:00100000:1.0:1788592642.873617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592642.873661:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c71c76f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225915136:0@lo:38: 00000100:00100000:1.0:1788592642.873691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592642.873724:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff0a6abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225915264:0@lo:400: 00000100:00100000:1.0:1788592642.873746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592642.873765:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592642.873770:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000900ce21a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225915392:0@lo:400: 00000100:00100000:1.0:1788592642.873794:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592642.873832:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225914880 00000100:00100000:1.0:1788592642.873839:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225914880 00000100:00100000:1.0:1788592642.873880:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592642.873887:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001a38ff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3641:x1875475225914880:12345-0@lo:400: 00000100:00100000:1.0:1788592642.873971:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001a38ff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3641:x1875475225914880:12345-0@lo:400: Request processed in 84us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592642.873979:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592642.874011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915008 00000100:00100000:1.0:1788592642.874015:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915008 00000100:00100000:1.0:1788592642.874035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915392 00000100:00100000:1.0:1788592642.874038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915392 00000100:00100000:1.0:1788592642.874048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592642.874052:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc97e6b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225915008:12345-0@lo:400: 00000100:00100000:1.0:1788592642.874103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc97e6b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225915008:12345-0@lo:400: Request processed in 50us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592642.874109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592642.874121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592642.874126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be006b75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225915392:12345-0@lo:400: 00000100:00100000:1.0:1788592642.874154:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be006b75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225915392:12345-0@lo:400: Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592642.874159:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592642.874174:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915136 00000100:00100000:1.0:1788592642.874177:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915136 00000100:00100000:1.0:1788592642.874188:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915264 00000100:00100000:1.0:1788592642.874190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915264 00000100:00100000:1.0:1788592642.874203:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592642.874207:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ff7839 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875475225915136:12345-0@lo:38: 00010000:00080000:1.0:1788592642.874229:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:1.0:1788592642.874263:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db4a13 00000004:00100000:1.0:1788592642.874276:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788592642.874281:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:1.0:1788592642.874376:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005abf4030 x1875475225915008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592642.874523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005abf4030 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225915008:0@lo:400: 00000100:00100000:1.0:1788592642.874537:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225914880:0@lo:400: 00010000:00080000:1.0:1788592642.874569:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000900ce21a x1875475225915392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592642.874578:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000900ce21a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225915392:0@lo:400: 00000100:00100000:0.0:1788592642.875371:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000900ce21a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225915520:0@lo:41: 00000100:00100000:0.0:1788592642.875555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592642.876950:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788592642.876971:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788592642.878664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915520 00000100:00100000:2.0:1788592642.878675:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915520 00000100:00100000:1.0:1788592642.881963:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592642.881979:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cbbca96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875475225915264:12345-0@lo:400: 00000100:00100000:1.0:1788592642.882096:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cbbca96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875475225915264:12345-0@lo:400: Request processed in 121us (8348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592642.882104:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592642.882122:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592642.882127:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a505a85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225915520:12345-0@lo:41: 00000100:00100000:3.0:1788592642.882131:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff0a6abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225915264:0@lo:400: 00000004:00000024:1.0:1788592642.882149:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788592642.882194:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a505a85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225915520:12345-0@lo:41: Request processed in 67us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592642.882200:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788592642.882307:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000900ce21a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225915520:0@lo:41: 00000100:00080000:0.0:1788592642.889259:0:6518:0:(import.c:65:import_set_state_nolock()) 000000005f424000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592642.889351:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ff7839 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1875475225915136:12345-0@lo:38: Request processed in 15140us (15657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592642.889363:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592642.889480:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592642.889489:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788592642.889497:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788592642.889502:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788592642.889504:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000020b94d32 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788592642.889518:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000051f7164e): req@0000000028f2c406 x1875475225910912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592642.889533:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c71c76f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225915136:0@lo:38: 00000100:00100000:0.0:1788592642.889598:0:7461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592642.889640:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051f7164e going to sleep for 11 seconds 00000100:00100000:0.0:1788592642.889655:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225910912 00000100:00100000:0.0:1788592642.889659:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225910912 00000100:00100000:0.0:1788592642.889694:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592642.889701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a628b81d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225910912:12345-0@lo:1000: 00000100:00100000:0.0:1788592642.889765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a628b81d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225910912:12345-0@lo:1000: Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592642.889771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592642.889796:0:7461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028f2c406 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225910912:0@lo:1000: 00000040:01000000:0.0:1788592642.889827:0:7461:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788592642.890133:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225915648:0@lo:41: 00000100:00100000:2.0:1788592642.890161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592642.890195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915648 00000100:00100000:2.0:1788592642.890198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915648 00000100:00100000:2.0:1788592642.890221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592642.890226:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbc2aaf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475225915648:12345-0@lo:41: 00000004:00000024:2.0:1788592642.890245:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788592642.890279:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbc2aaf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475225915648:12345-0@lo:41: Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592642.890285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592642.890314:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225915648:0@lo:41: 00000100:00100000:0.0:1788592642.890451:0:7461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010c70ea2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225915776:0@lo:1000: 00000100:00100000:0.0:1788592642.890493:0:7461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592642.890512:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d94bb96 going to sleep for 11 seconds 00000100:00100000:2.0:1788592642.890701:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915776 00000100:00100000:2.0:1788592642.890705:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915776 00000100:00100000:2.0:1788592642.890734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592642.890739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b642ff0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225915776:12345-0@lo:1000: 00000100:00100000:2.0:1788592642.890825:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b642ff0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225915776:12345-0@lo:1000: Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592642.890831:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592642.890866:0:7461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010c70ea2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225915776:0@lo:1000: 00000100:00100000:2.0:1788592642.890903:0:7461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225915904:0@lo:700: 00000100:00100000:2.0:1788592642.890923:0:7461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592642.890937:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0029e58 going to sleep for 11 seconds 00000100:00100000:2.0:1788592642.890953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225915904 00000100:00100000:2.0:1788592642.890957:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225915904 00000100:00100000:2.0:1788592642.890989:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592642.890995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000676340cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225915904:12345-0@lo:700: 00000100:00100000:2.0:1788592642.891034:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000676340cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225915904:12345-0@lo:700: Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592642.891040:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592642.891086:0:7461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225915904:0@lo:700: 00000100:00100000:2.0:1788592642.891167:0:7461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225916032:0@lo:1000: 00000100:00100000:2.0:1788592642.891193:0:7461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592642.891206:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046d15a28 going to sleep for 11 seconds 00000100:00100000:2.0:1788592642.891269:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225916032 00000100:00100000:2.0:1788592642.891272:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225916032 00000100:00100000:2.0:1788592642.891288:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592642.891293:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7bf0a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225916032:12345-0@lo:1000: 00000100:00100000:2.0:1788592642.891337:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7bf0a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225916032:12345-0@lo:1000: Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592642.891344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592642.891367:0:7461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225916032:0@lo:1000: 00000004:00080000:2.0:1788592642.891531:0:7461:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f0029e58 with version 0 00000020:00100000:2.0:1788592642.891545:0:7461:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788592642.891551:0:7461:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000288494fc x1875475225916288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592642.891562:0:7461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225916288:0@lo:1000: 00000100:00100000:2.0:1788592642.891584:0:7461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592642.891598:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 000000008cb2120e going to sleep for 11 seconds 00000100:00100000:2.0:1788592642.891608:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225916288 00000100:00100000:2.0:1788592642.891611:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225916288 00000100:00100000:2.0:1788592642.891644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788592642.891648:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac2a0a62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7461:x1875475225916288:12345-0@lo:1000: 00000001:00080000:1.0:1788592642.893958:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788592642.893969:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788592642.895333:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac2a0a62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7461:x1875475225916288:12345-0@lo:1000: Request processed in 3678us (3742us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788592642.895345:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788592642.895348:0:7461:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788592642.895352:0:7461:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788592642.895366:0:7461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225916288:0@lo:1000: 00000100:00100000:2.0:1788592642.896043:0:7461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225916416:0@lo:1000: 00000100:00100000:2.0:1788592642.896156:0:7461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592642.896180:0:7461:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040e9c074 going to sleep for 11 seconds 00000100:00100000:3.0:1788592642.896310:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225916416 00000100:00100000:3.0:1788592642.896316:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225916416 00000100:00100000:3.0:1788592642.896370:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592642.896378:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c6137f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7461:x1875475225916416:12345-0@lo:1000: 00000100:00100000:3.0:1788592642.896463:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c6137f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7461:x1875475225916416:12345-0@lo:1000: Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592642.896469:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592642.896947:0:7461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7461:1875475225916416:0@lo:1000: 00000040:00080000:2.0:1788592642.896967:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788592642.896997:0:7461:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008cb2120e with version 1 00000004:00080000:1.0:1788592642.897174:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000df867515 version 1 rpc_version 1 00000020:00100000:1.0:1788592642.897193:0:7457:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788592642.897208:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002bd89330 x1875475225916672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592642.897224:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7457:1875475225916672:0@lo:1000: 00000100:00100000:1.0:1788592642.897262:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592642.897280:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fcad908 going to sleep for 11 seconds 00000100:00100000:3.0:1788592642.897384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225916672 00000100:00100000:3.0:1788592642.897388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225916672 00000100:00100000:3.0:1788592642.897421:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592642.897428:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005abf4030 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7457:x1875475225916672:12345-0@lo:1000: 00000001:00080000:1.0:1788592642.901611:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788592642.901756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005abf4030 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7457:x1875475225916672:12345-0@lo:1000: Request processed in 4325us (4490us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788592642.901768:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788592642.901822:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788592642.901826:0:7457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788592642.901844:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7457:1875475225916672:0@lo:1000: 00000040:00080000:2.0:1788592642.916304:0:7461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788592642.916515:0:7461:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 5, retries 0 00000004:00080000:2.0:1788592642.916520:0:7461:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788592643.000299:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592644.024941:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592645.048761:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788592645.165704:0:7871:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592645.165917:0:7871:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788592646.072694:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592646.223446:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc90a319c0 20000000:00000080:1.0:1788592646.223464:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92187d74fc00 uarg=0000000000000000 20000000:01000000:1.0:1788592646.223514:0:7919:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788592646.223521:0:7919:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788592646.223525:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788592646.223589:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788592646.223600:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788592646.226683:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592646.226896:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788592646.226928:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788592646.226943:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788592646.226959:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788592646.226977:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.226995:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db48ae expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.227001:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49db expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.227012:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.227059:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db49db expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.227115:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db49db expref: 15 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.227129:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875475225916800:0@lo:104: 00000100:00100000:1.0:1788592646.227194:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592646.227249:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db48ae expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.227257:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db48ae expref: 15 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.227265:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875475225916928:0@lo:104: 00000100:00100000:1.0:1788592646.227280:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8fc402e going to sleep for 11 seconds 00000100:00100000:3.0:1788592646.227991:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788592646.228016:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592646.228060:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225916800 00000100:00100000:3.0:1788592646.228097:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225916800 00000100:00100000:0.0:1788592646.228103:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225916928 00000100:00100000:0.0:1788592646.228110:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225916928 00000100:00100000:3.0:1788592646.228144:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592646.228153:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c5f658 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:7919:x1875475225916800:12345-0@lo:104: 00010000:00010000:3.0:1788592646.228165:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592646.228228:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592646.228233:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c5f658 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:7919:x1875475225916800:12345-0@lo:104: Request processed in 84us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592646.228241:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788592646.228267:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592646.228274:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592646.228283:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788592646.228285:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000fae4622 already unused, calling callback (00000000800d70aa) 10000000:00010000:0.0:1788592646.228290:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592646.228293:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046683090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:7919:x1875475225916928:12345-0@lo:104: 00010000:00010000:3.0:1788592646.228306:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228307:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592646.228325:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592646.228332:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592646.228356:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592646.228361:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046683090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:7919:x1875475225916928:12345-0@lo:104: Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592646.228367:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788592646.228375:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228383:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592646.228384:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592646.228406:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228413:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 000000000fae4622/0xbd314a3362db49db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49e2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228426:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592646.228428:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592646.228439:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592646.228448:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592646.228459:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3f130ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225917056:0@lo:103: 00000100:00100000:0.0:1788592646.228495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.228533:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917056 00000100:00100000:0.0:1788592646.228537:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917056 00010000:00010000:0.0:1788592646.228554:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49db expref: 16 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592646.228578:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592646.228584:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d8d95d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3640:x1875475225917056:12345-0@lo:103: 00010000:00010000:0.0:1788592646.228596:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592646.228601:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49db expref: 16 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228624:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db49db expref: 16 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228643:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592646.228678:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d8d95d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3640:x1875475225917056:12345-0@lo:103: Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.228686:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592646.228720:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3f130ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225917056:0@lo:103: 00010000:00010000:3.0:1788592646.228747:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592646.228750:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592646.228752:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592646.228759:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228766:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c2bc36d already unused, calling callback (00000000800d70aa) 10000000:00010000:0.0:1788592646.228769:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228786:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592646.228792:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592646.228797:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592646.228811:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228817:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592646.228832:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228836:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: 000000004c2bc36d/0xbd314a3362db48ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db48b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228847:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592646.228848:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592646.228849:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592646.228852:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592646.228858:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3f130ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225917184:0@lo:103: 00000100:00100000:0.0:1788592646.228876:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.228893:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917184 00000100:00100000:0.0:1788592646.228905:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917184 00010000:00010000:0.0:1788592646.228914:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48ae expref: 16 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592646.228928:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592646.228931:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cce50d9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3639:x1875475225917184:12345-0@lo:103: 00010000:00010000:0.0:1788592646.228941:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592646.228944:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db48ae expref: 16 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228949:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db48ae expref: 16 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228957:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228962:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228971:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228975:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228979:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228982:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228985:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013e8d2e9 already unused, calling callback (00000000e5ac922e) 00010000:00010000:0.0:1788592646.228987:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.228990:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.229001:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.229008:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592646.229026:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cce50d9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3639:x1875475225917184:12345-0@lo:103: Request processed in 95us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.229030:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592646.229049:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3f130ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225917184:0@lo:103: 10000000:01000000:2.0:1788592646.229162:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788592646.229166:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921875948800 from 4 10000000:01000000:2.0:1788592646.229169:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592646.229191:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.229210:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.229218:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592646.229230:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917312:0@lo:101: 00000100:00100000:2.0:1788592646.229262:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.229308:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046d15a28 going to sleep for 11 seconds 00010000:00010000:1.0:1788592646.229437:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e3ee70e/0xbd314a3362db49e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db49db expref: 15 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.229450:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bd89330 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875475225916800:0@lo:104: 00010000:00010000:1.0:1788592646.229457:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073d91a0f/0xbd314a3362db48b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db48ae expref: 14 pid: 6504 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.229464:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875475225916928:0@lo:104: 00010000:00010000:1.0:1788592646.229480:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592646.229488:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917312 00000100:00100000:0.0:1788592646.229495:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917312 00010000:00010000:1.0:1788592646.229497:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.229506:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.229512:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013e8d2e9/0xbd314a3362db4a1a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592646.229529:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592646.229537:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6f834aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225917312:12345-0@lo:101: 00010000:00010000:0.0:1788592646.229548:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592646.229559:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fb7bd7b/0xbd314a3362db4a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a21 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.229574:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fb7bd7b/0xbd314a3362db4a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.229583:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fb7bd7b/0xbd314a3362db4a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.229590:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fb7bd7b, rc 0) 00000100:00100000:0.0:1788592646.229640:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6f834aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225917312:12345-0@lo:101: Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.229647:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788592646.229756:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000288494fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917312:0@lo:101: 00010000:00010000:3.0:1788592646.229777:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592646.229784:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592646.229829:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff557f90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917440:0@lo:256: 00000100:00100000:3.0:1788592646.229862:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592646.233425:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d96bb8a going to sleep for 11 seconds 00000100:00100000:0.0:1788592646.233527:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917440 00000100:00100000:0.0:1788592646.233543:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917440 00000100:00100000:0.0:1788592646.233632:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788592646.233639:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000302b46d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225917440:12345-0@lo:256: 20000000:01000000:0.0:1788592646.233661:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592646.233675:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592646.233678:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788592646.233806:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000302b46d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225917440:12345-0@lo:256: Request processed in 167us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.233814:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788592646.233886:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff557f90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917440:0@lo:256: 10000000:01000000:2.0:1788592646.233955:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592646.233963:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.233974:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: 00000000dad44eca/0xbd314a3362db4a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592646.233983:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592646.233986:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921875948800 from 1 10000000:01000000:2.0:1788592646.233988:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592646.234016:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: 00000000e2e9c90a/0xbd314a3362db4a2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.234023:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: 00000000e2e9c90a/0xbd314a3362db4a2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.234030:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: 00000000e2e9c90a/0xbd314a3362db4a2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592646.234047:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdee4a25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917568:0@lo:101: 00000100:00100000:2.0:1788592646.234101:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.234277:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046d15a28 going to sleep for 11 seconds 00000100:00100000:3.0:1788592646.235456:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917568 00000100:00100000:3.0:1788592646.235466:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917568 00000100:00100000:3.0:1788592646.235501:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788592646.235508:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f3826a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225917568:12345-0@lo:101: 00010000:00010000:3.0:1788592646.235519:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592646.235533:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a2f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592646.235556:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592646.235566:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb0c4924/0xbd314a3362db4a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592646.235575:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb0c4924, rc 0) 00000100:00100000:3.0:1788592646.235844:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f3826a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225917568:12345-0@lo:101: Request processed in 336us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592646.235851:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788592646.235988:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdee4a25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917568:0@lo:101: 00010000:00010000:2.0:1788592646.236004:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: 00000000e2e9c90a/0xbd314a3362db4a2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.236013:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: 00000000e2e9c90a/0xbd314a3362db4a2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592646.236177:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdee4a25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917696:0@lo:501: 00000100:00100000:2.0:1788592646.236228:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.236251:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046d15a28 going to sleep for 11 seconds 00000100:00100000:3.0:1788592646.236305:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917696 00000100:00100000:3.0:1788592646.236309:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917696 00000100:00100000:3.0:1788592646.236338:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788592646.236344:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000892ef65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225917696:12345-0@lo:501: 00000100:00100000:3.0:1788592646.236467:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000892ef65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225917696:12345-0@lo:501: Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592646.236474:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788592646.236542:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdee4a25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917696:0@lo:501: 00000100:00100000:2.0:1788592646.236570:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdee4a25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917824:0@lo:503: 00000100:00100000:2.0:1788592646.236619:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.236639:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046d15a28 going to sleep for 11 seconds 00000100:00100000:3.0:1788592646.237029:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917824 00000100:00100000:3.0:1788592646.237035:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917824 00000100:00100000:3.0:1788592646.237056:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788592646.237062:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000092ab675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225917824:12345-0@lo:503: 00000100:00100000:3.0:1788592646.237181:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000092ab675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225917824:12345-0@lo:503: Request processed in 120us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592646.237205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788592646.237407:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdee4a25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225917824:0@lo:503: 00000100:00100000:1.0:1788592646.241252:0:7921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7921:1875475225917952:0@lo:502: 00000100:00100000:1.0:1788592646.241335:0:7921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.241376:0:7921:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ca57007 going to sleep for 11 seconds 00000100:00100000:0.0:1788592646.241488:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225917952 00000100:00100000:0.0:1788592646.241495:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225917952 00000100:00100000:0.0:1788592646.241569:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788592646.241578:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f5b55ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7921:x1875475225917952:12345-0@lo:502: 00000100:00100000:0.0:1788592646.241739:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f5b55ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7921:x1875475225917952:12345-0@lo:502: Request processed in 162us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.241748:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592646.242323:0:7921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098517de9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7921:1875475225917952:0@lo:502: 00000020:01000000:2.0:1788592646.242484:0:7921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592646.242494:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592646.242497:0:7921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788592646.242504:0:7921:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff921875948800 00000020:00000080:2.0:1788592646.242507:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788592646.242551:0:7921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7921:1875475225918080:0@lo:502: 00000100:00100000:2.0:1788592646.242598:0:7921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.242672:0:7921:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218513c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592646.242740:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918080 00000100:00100000:1.0:1788592646.242746:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918080 00000100:00100000:1.0:1788592646.242788:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788592646.242796:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7921:x1875475225918080:12345-0@lo:502: 00000100:00100000:1.0:1788592646.243039:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:7921:x1875475225918080:12345-0@lo:502: Request processed in 243us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592646.243047:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592646.243190:0:7921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7921:1875475225918080:0@lo:502: 00000020:01000000:2.0:1788592646.243216:0:7921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592646.243221:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592646.243223:0:7921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788592646.243227:0:7921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788592646.243290:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788592646.243323:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592646.243333:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.243344:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592646.243353:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788592646.243356:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921846c66000 from 4 10000000:01000000:0.0:1788592646.243358:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788592646.243383:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.243403:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.243413:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592646.243427:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918208:0@lo:101: 00000100:00100000:0.0:1788592646.243460:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.243486:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592646.243509:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918208 00000100:00100000:2.0:1788592646.243514:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918208 00000100:00100000:2.0:1788592646.243541:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592646.243554:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225918208:12345-0@lo:101: 00010000:00010000:2.0:1788592646.243564:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592646.243575:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a3d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.243594:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.243614:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592646.243623:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca600, rc 0) 00000100:00100000:2.0:1788592646.243664:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225918208:12345-0@lo:101: Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.243670:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788592646.245584:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918208:0@lo:101: 00010000:00010000:1.0:1788592646.245619:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.245631:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.245695:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918336:0@lo:256: 00000100:00100000:1.0:1788592646.245755:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.245791:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592646.245958:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918336 00000100:00100000:2.0:1788592646.245964:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918336 00000100:00100000:2.0:1788592646.246012:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788592646.246022:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225918336:12345-0@lo:256: 20000000:01000000:2.0:1788592646.246040:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788592646.246055:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788592646.246058:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788592646.246561:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225918336:12345-0@lo:256: Request processed in 540us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.246569:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788592646.247252:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918336:0@lo:256: 10000000:01000000:1.0:1788592646.247300:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592646.247309:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.247318:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592646.247327:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592646.247341:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921846c66000 from 1 10000000:01000000:1.0:1788592646.247343:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592646.247371:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.247379:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.247388:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.247403:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918464:0@lo:101: 00000100:00100000:1.0:1788592646.247451:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.247487:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592646.248199:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918464 00000100:00100000:0.0:1788592646.248207:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918464 00000100:00100000:0.0:1788592646.248256:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788592646.248265:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225918464:12345-0@lo:101: 00010000:00010000:0.0:1788592646.248276:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592646.248290:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a4b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.248324:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.248335:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.248344:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030e00, rc 0) 00000100:00100000:0.0:1788592646.248387:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225918464:12345-0@lo:101: Request processed in 122us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.248393:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788592646.248491:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918464:0@lo:101: 00010000:00010000:1.0:1788592646.248506:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592646.248525:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592646.248590:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918592:0@lo:501: 00000100:00100000:1.0:1788592646.248628:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.248650:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592646.248735:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918592 00000100:00100000:2.0:1788592646.248740:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918592 00000100:00100000:2.0:1788592646.248779:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788592646.248787:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225918592:12345-0@lo:501: 00000100:00100000:2.0:1788592646.248908:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225918592:12345-0@lo:501: Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.248916:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788592646.248948:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918592:0@lo:501: 00000100:00100000:1.0:1788592646.248974:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918720:0@lo:503: 00000100:00100000:1.0:1788592646.249009:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.249029:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592646.249559:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918720 00000100:00100000:0.0:1788592646.249572:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918720 00000100:00100000:0.0:1788592646.249601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788592646.249618:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225918720:12345-0@lo:503: 00000100:00100000:0.0:1788592646.249708:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225918720:12345-0@lo:503: Request processed in 100us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.249714:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788592646.250005:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225918720:0@lo:503: 00000100:00100000:1.0:1788592646.257796:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7923:1875475225918848:0@lo:502: 00000100:00100000:1.0:1788592646.257876:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.257922:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592646.258047:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918848 00000100:00100000:2.0:1788592646.258054:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918848 00000100:00100000:2.0:1788592646.258118:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788592646.258127:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7923:x1875475225918848:12345-0@lo:502: 00000100:00100000:2.0:1788592646.258300:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7923:x1875475225918848:12345-0@lo:502: Request processed in 173us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.258308:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788592646.258588:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7923:1875475225918848:0@lo:502: 00000020:01000000:1.0:1788592646.258623:0:7923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592646.258631:0:7923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592646.258634:0:7923:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788592646.258640:0:7923:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff921846c66000 00000020:00000080:1.0:1788592646.258643:0:7923:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788592646.258664:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7923:1875475225918976:0@lo:502: 00000100:00100000:1.0:1788592646.258697:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592646.258753:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592646.258791:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225918976 00000100:00100000:2.0:1788592646.258795:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225918976 00000100:00100000:2.0:1788592646.258861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788592646.258869:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7923:x1875475225918976:12345-0@lo:502: 00000100:00100000:2.0:1788592646.258941:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:7923:x1875475225918976:12345-0@lo:502: Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.258948:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592646.259017:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:7923:1875475225918976:0@lo:502: 00000020:01000000:1.0:1788592646.259041:0:7923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592646.259045:0:7923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592646.259046:0:7923:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788592646.259050:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788592646.259437:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788592646.259467:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592646.259537:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592646.259549:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592647.098981:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592647.992310:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592647.992341:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225919104:0@lo:41: 00000100:00100000:0.0:1788592647.992411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592647.992490:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919104 00000100:00100000:1.0:1788592647.992498:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919104 00000100:00100000:1.0:1788592647.992550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592647.992559:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225919104:12345-0@lo:41: 00000004:00000024:1.0:1788592647.992591:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788592647.992649:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225919104:12345-0@lo:41: Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592647.992656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592647.992698:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225919104:0@lo:41: 00000100:00100000:1.0:1788592647.994141:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225919360:0@lo:400: 00000100:00100000:1.0:1788592647.994186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592647.994212:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592647.994217:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225919488:0@lo:400: 00000100:00100000:1.0:1788592647.994240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592647.994273:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919360 00000100:00100000:1.0:1788592647.994279:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919360 00000100:00100000:1.0:1788592647.994312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592647.994319:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225919360:12345-0@lo:400: 00000100:00100000:1.0:1788592647.994357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225919360:12345-0@lo:400: Request processed in 39us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592647.994364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592647.994381:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919488 00000100:00100000:1.0:1788592647.994384:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919488 00000100:00100000:1.0:1788592647.994416:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592647.994422:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225919488:12345-0@lo:400: 00000100:00100000:1.0:1788592647.994459:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225919488:12345-0@lo:400: Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592647.994464:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592647.994495:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225919488:0@lo:400: 00010000:00080000:1.0:1788592647.994507:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92187591c380 x1875475225919360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592647.994517:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225919360:0@lo:400: 00000100:00100000:0.0:1788592647.994582:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225919232:0@lo:400: 00000100:00100000:0.0:1788592647.994625:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592647.994655:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592647.994660:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225919616:0@lo:400: 00000100:00100000:0.0:1788592647.994681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592647.994945:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919232 00000100:00100000:1.0:1788592647.994949:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919232 00000100:00100000:1.0:1788592647.995019:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592647.995026:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3642:x1875475225919232:12345-0@lo:400: 00000100:00100000:1.0:1788592647.995063:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3642:x1875475225919232:12345-0@lo:400: Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592647.995085:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788592647.995266:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592647.995276:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225919744:0@lo:41: 00000100:00100000:3.0:1788592647.995310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592647.995335:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919744 00000100:00100000:3.0:1788592647.995338:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919744 00000100:00100000:3.0:1788592647.995362:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592647.995369:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225919744:12345-0@lo:41: 00000004:00000024:3.0:1788592647.995391:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788592647.995425:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225919744:12345-0@lo:41: Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592647.995431:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592647.995461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225919744:0@lo:41: 00000100:00100000:1.0:1788592647.995825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919616 00000100:00100000:1.0:1788592647.995830:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919616 00000100:00100000:1.0:1788592647.995873:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592647.995881:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225919616:12345-0@lo:400: 00000100:00100000:1.0:1788592647.995916:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225919616:12345-0@lo:400: Request processed in 36us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592647.995922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788592647.995950:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92187591fb80 x1875475225919616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592647.995962:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225919616:0@lo:400: 00000100:00100000:1.0:1788592647.995982:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225919232:0@lo:400: 00010000:00010000:1.0:1788592648.120358:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592649.144175:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592650.172699:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592651.194375:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592652.218257:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592653.112241:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475225920000:0@lo:400: 00000100:00100000:0.0:1788592653.112326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592653.112383:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788592653.112390:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225919872:0@lo:400: 00000100:00100000:0.0:1788592653.112425:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592653.112452:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225920384:0@lo:400: 00000100:00100000:0.0:1788592653.112479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592653.112503:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225920512:0@lo:41: 00000100:00100000:0.0:1788592653.112524:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592653.112571:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225920128:0@lo:400: 00000100:00100000:0.0:1788592653.112593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592653.112609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225920640:0@lo:41: 00000100:00100000:0.0:1788592653.112627:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592653.112643:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592653.112648:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225920256:0@lo:400: 00000100:00100000:0.0:1788592653.112675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592653.112698:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225919872 00000100:00100000:0.0:1788592653.112706:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920000 00000100:00100000:2.0:1788592653.112708:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225919872 00000100:00100000:0.0:1788592653.112713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920000 00000100:00100000:0.0:1788592653.112758:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920384 00000100:00100000:0.0:1788592653.112762:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920384 00000100:00100000:2.0:1788592653.112767:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788592653.112779:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3640:x1875475225919872:12345-0@lo:400: 00000100:00100000:0.0:1788592653.112784:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592653.112794:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475225920000:12345-0@lo:400: 00000100:00100000:2.0:1788592653.112849:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3640:x1875475225919872:12345-0@lo:400: Request processed in 68us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592653.112856:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788592653.112872:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920512 00000100:00100000:3.0:1788592653.112878:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920512 00000100:00100000:3.0:1788592653.112900:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920128 00000100:00100000:3.0:1788592653.112908:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920128 00000100:00100000:3.0:1788592653.112920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920640 00000100:00100000:3.0:1788592653.112922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920640 00000100:00100000:3.0:1788592653.112929:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920256 00000100:00100000:3.0:1788592653.112931:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920256 00000100:00100000:3.0:1788592653.112941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592653.112947:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875475225920512:12345-0@lo:41: 00000004:00000024:3.0:1788592653.112972:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788592653.113036:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475225920000:12345-0@lo:400: Request processed in 243us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592653.113043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592653.113056:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592653.113063:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225920384:12345-0@lo:400: 00000100:00100000:0.0:1788592653.113113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225920384:12345-0@lo:400: Request processed in 51us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592653.113128:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592653.113151:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592653.113159:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475225920128:12345-0@lo:400: 00000100:00100000:0.0:1788592653.113197:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475225920128:12345-0@lo:400: Request processed in 39us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592653.113203:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592653.113219:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592653.113226:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225920640:12345-0@lo:41: 00000004:00000024:0.0:1788592653.113252:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788592653.113260:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225920128:0@lo:400: 00000100:00100000:0.0:1788592653.113288:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225920640:12345-0@lo:41: Request processed in 62us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592653.113293:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225920640:0@lo:41: 00000100:00100000:0.0:1788592653.113297:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592653.113312:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788592653.113320:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875475225920256:12345-0@lo:400: 00000100:00100000:0.0:1788592653.113352:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875475225920256:12345-0@lo:400: Request processed in 34us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592653.113358:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592653.113411:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225920256:0@lo:400: 00000100:00100000:3.0:1788592653.113826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225920512:12345-0@lo:41: Request processed in 879us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592653.113832:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788592653.114495:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225920512:0@lo:41: 00000100:00100000:0.0:1788592653.114507:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225919872:0@lo:400: 00010000:00080000:0.0:1788592653.114525:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921875a3dc00 x1875475225920384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592653.114536:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225920384:0@lo:400: 00010000:00080000:0.0:1788592653.114547:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921875a3e680 x1875475225920000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592653.114581:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475225920000:0@lo:400: 00010000:00010000:0.0:1788592653.241375:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788592653.897546:0:8420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788592653.897550:0:8420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788592653.897563:0:8420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788592653.897741:0:8420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9218764b9000 00000020:01000004:2.0:1788592653.897757:0:8420:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788592653.897768:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788592653.897782:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92187d788000) 00000020:00000080:2.0:1788592653.897797:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788592653.950571:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788592653.950625:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788592653.973347:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788592653.973549:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788592653.973572:0:8420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788592653.973583:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd314a3362db4a60 00000020:01000004:1.0:1788592653.973589:0:8420:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788592653.973782:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788592653.973786:0:8420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788592653.973792:0:8420:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788592653.973797:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788592653.973816:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92186d5999c0) 00000020:00000080:1.0:1788592653.973829:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1788592653.978788:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592653.978976:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788592653.978982:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788592653.982194:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788592653.982206:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788592653.982655:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788592653.982662:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788592653.985785:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592653.985962:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788592653.985972:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788592653.986681:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788592653.986688:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788592654.022001:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592654.022421:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788592654.022427:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788592654.023509:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788592654.023519:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788592654.025773:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788592654.025789:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788592654.028196:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592654.028376:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788592654.028385:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788592654.028988:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788592654.028995:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788592654.076039:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592654.077559:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788592654.077566:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788592654.080567:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788592654.080583:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788592654.081261:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788592654.081290:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788592654.081296:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788592654.125864:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788592654.125895:0:8420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788592654.125898:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788592654.125899:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592654.125900:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592654.125900:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592654.125901:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592654.125902:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592654.125903:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592654.125904:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592654.125905:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592654.125906:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592654.125906:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592654.125910:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788592654.125911:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592654.125912:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592654.125913:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592654.125916:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592654.125917:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592654.125917:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592654.125918:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592654.125918:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592654.125919:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592654.125920:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592654.125920:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592654.125947:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788592654.125961:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225920768:0@lo:253: 00000100:00100000:2.0:1788592654.126015:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.126219:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218462d4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.126254:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920768 00000100:00100000:1.0:1788592654.126262:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920768 00000100:00100000:1.0:1788592654.126315:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788592654.126322:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:8420:x1875475225920768:12345-0@lo:253: 20000000:01000000:1.0:1788592654.126372:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788592654.126375:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788592654.126378:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788592654.126381:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788592654.126643:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592654.126804:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788592654.126818:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788592654.126834:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788592654.126840:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788592654.126875:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788592654.126958:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788592654.127037:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788592654.127051:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.147@tcp 20000000:01000000:1.0:1788592654.127053:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592654.127088:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788592654.127095:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788592654.127112:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788592654.127118:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592654.127130:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788592654.127137:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788592654.127148:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788592654.127362:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788592654.127436:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788592654.127447:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.147@tcp 20000000:01000000:1.0:1788592654.127449:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592654.127464:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788592654.127479:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788592654.127495:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788592654.127501:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592654.127513:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788592654.127518:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788592654.127532:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788592654.127547:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788592654.127921:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788592654.127935:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.147@tcp 20000000:01000000:1.0:1788592654.127936:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592654.127952:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788592654.127959:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788592654.127972:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788592654.127978:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592654.127991:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788592654.127997:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788592654.128010:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788592654.128027:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788592654.128040:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788592654.128042:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788592654.128045:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788592654.128623:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788592654.128627:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788592654.131395:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788592654.131445:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788592654.131464:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788592654.131908:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788592654.131931:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788592654.131947:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788592654.131957:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788592654.131960:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788592654.132744:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788592654.132770:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788592654.132786:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788592654.133210:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788592654.133232:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788592654.133247:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788592654.133257:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788592654.133268:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788592654.133929:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788592654.133961:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788592654.133977:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788592654.134602:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788592654.134625:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788592654.134772:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1788592654.134784:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788592654.134786:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788592654.135561:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788592654.135727:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788592654.135750:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788592654.135766:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1788592654.135782:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788592654.135801:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135819:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4933 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135827:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4972 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135834:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4980 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135840:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135847:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135855:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135893:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.135921:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 18 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592654.135938:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225920896:0@lo:104: 00000100:00100000:1.0:1788592654.135996:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592654.136125:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.136134:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 18 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592654.136142:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921024:0@lo:104: 00000100:00100000:1.0:1788592654.136164:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592654.138176:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4980 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.138192:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4980 expref: 18 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592654.138203:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921152:0@lo:104: 00000100:00100000:1.0:1788592654.138244:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592654.138361:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225920896 00000100:00100000:3.0:1788592654.138368:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225920896 00000100:00100000:2.0:1788592654.138468:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921024 00000100:00100000:2.0:1788592654.138472:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921024 00000100:00100000:2.0:1788592654.138487:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592654.138495:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6507:x1875475225920896:12345-0@lo:104: 00010000:00010000:2.0:1788592654.138507:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.138588:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592654.138595:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6507:x1875475225920896:12345-0@lo:104: Request processed in 101us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.138611:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592654.138629:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592654.138646:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6507:x1875475225921024:12345-0@lo:104: 00010000:00010000:2.0:1788592654.138654:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.138691:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592654.138696:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6507:x1875475225921024:12345-0@lo:104: Request processed in 62us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.138702:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788592654.138834:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592654.138840:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138847:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592654.138851:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138859:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592654.138866:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592654.138870:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592654.138907:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138924:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592654.138942:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138949:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db49e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49f0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138962:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592654.138965:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138970:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592654.138973:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.138979:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592654.138985:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592654.138990:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592654.139003:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.139008:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592654.139022:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.139029:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db49c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db49d4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.139044:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.139046:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.139048:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592654.139056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592654.139090:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225921280:0@lo:103: 00000100:00100000:3.0:1788592654.139123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592654.139158:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225921408:0@lo:103: 00000100:00100000:3.0:1788592654.139180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592654.139386:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4972 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.139397:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4972 expref: 18 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592654.139407:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921536:0@lo:104: 00000100:00100000:1.0:1788592654.139450:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592654.139472:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4933 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.139480:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4933 expref: 18 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592654.139488:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921664:0@lo:104: 00000100:00100000:1.0:1788592654.139509:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592654.139519:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.139536:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225920896:0@lo:104: 00000100:00100000:1.0:1788592654.139544:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921024:0@lo:104: 00000100:00100000:2.0:1788592654.139610:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921152 00000100:00100000:2.0:1788592654.139615:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921152 00000100:00100000:2.0:1788592654.139636:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921536 00000100:00100000:2.0:1788592654.139639:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921536 00000100:00100000:2.0:1788592654.139647:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921664 00000100:00100000:2.0:1788592654.139649:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921664 00000100:00100000:2.0:1788592654.139659:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592654.139665:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6507:x1875475225921152:12345-0@lo:104: 00010000:00010000:2.0:1788592654.139674:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.139729:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592654.139734:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6507:x1875475225921152:12345-0@lo:104: Request processed in 69us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.139741:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592654.139752:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592654.139758:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6507:x1875475225921536:12345-0@lo:104: 00010000:00010000:2.0:1788592654.139773:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.139802:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592654.139806:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6507:x1875475225921536:12345-0@lo:104: Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.139813:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592654.139824:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592654.139829:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6507:x1875475225921664:12345-0@lo:104: 00010000:00010000:2.0:1788592654.139836:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.139860:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788592654.139865:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6507:x1875475225921664:12345-0@lo:104: Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.139870:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592654.139930:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921152:0@lo:104: 00000100:00100000:1.0:1788592654.139938:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921536:0@lo:104: 00000100:00100000:1.0:1788592654.139945:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1875475225921664:0@lo:104: 00010000:00010000:1.0:1788592654.139966:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140018:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788592654.140023:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140030:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f800 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592654.140033:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140041:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592654.140048:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592654.140053:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592654.140101:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140108:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592654.140126:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140140:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db4980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4987 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140149:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592654.140152:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140158:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592654.140161:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140168:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592654.140174:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592654.140179:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592654.140193:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140199:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592654.140209:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140215:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140223:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592654.140232:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140238:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592654.140241:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140248:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592654.140254:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592654.140258:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592654.140271:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140276:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592654.140281:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140287:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db493a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.140299:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.140301:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.140302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.140308:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592654.140318:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225921920:0@lo:103: 00000100:00100000:3.0:1788592654.140346:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592654.140369:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592654.140381:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225922048:0@lo:103: 00000100:00100000:3.0:1788592654.140403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592654.140456:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592654.140464:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225921792:0@lo:103: 00000100:00100000:1.0:1788592654.140490:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592654.140627:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592654.140692:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921280 00000100:00100000:0.0:1788592654.140697:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921280 00010000:00010000:0.0:1788592654.140719:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 19 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.140735:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921408 00000100:00100000:0.0:1788592654.140738:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921408 00010000:00010000:0.0:1788592654.140748:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 20 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.140757:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921920 00000100:00100000:0.0:1788592654.140759:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921920 00010000:00010000:0.0:1788592654.140766:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4972 expref: 21 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.140775:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922048 00000100:00100000:0.0:1788592654.140778:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922048 00010000:00010000:0.0:1788592654.140786:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4933 expref: 22 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.140794:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225921792 00000100:00100000:0.0:1788592654.140796:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225921792 00010000:00010000:0.0:1788592654.140816:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4980 expref: 23 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.140829:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592654.140834:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3641:x1875475225921280:12345-0@lo:103: 00010000:00010000:0.0:1788592654.140844:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592654.140848:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 23 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.140859:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 23 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.140872:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205ee00/0xbd314a3362db49f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db49e9 expref: 23 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.140885:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592654.141001:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3641:x1875475225921280:12345-0@lo:103: Request processed in 165us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592654.141008:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592654.141022:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592654.141029:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3639:x1875475225921408:12345-0@lo:103: 00010000:00010000:0.0:1788592654.141037:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592654.141041:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 21 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141050:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 21 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141059:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821cbc00/0xbd314a3362db49d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db49c6 expref: 21 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141108:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592654.141142:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3639:x1875475225921408:12345-0@lo:103: Request processed in 114us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592654.141148:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592654.141160:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788592654.141166:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3641:x1875475225921920:12345-0@lo:103: 00010000:00010000:0.0:1788592654.141173:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592654.141177:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4972 expref: 19 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141184:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4972 expref: 19 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141193:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821ca200/0xbd314a3362db4979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4972 expref: 19 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141202:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592654.141222:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3641:x1875475225921920:12345-0@lo:103: Request processed in 57us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592654.141228:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788592654.141240:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592654.141246:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:3641:x1875475225922048:12345-0@lo:103: 00010000:00010000:0.0:1788592654.141253:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592654.141257:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4933 expref: 17 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141265:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4933 expref: 17 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141281:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b521c00/0xbd314a3362db493a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4933 expref: 17 pid: 6505 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141289:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592654.141310:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3641:x1875475225922048:12345-0@lo:103: Request processed in 65us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592654.141316:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592654.141327:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592654.141332:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3639:x1875475225921792:12345-0@lo:103: 00010000:00010000:0.0:1788592654.141338:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592654.141342:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4980 expref: 15 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141351:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4980 expref: 15 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141360:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821cba00/0xbd314a3362db4987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4980 expref: 15 pid: 6504 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141369:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141376:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141390:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141397:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141409:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141415:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141420:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592654.141424:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141432:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141448:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.141457:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592654.141479:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:3639:x1875475225921792:12345-0@lo:103: Request processed in 147us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592654.141485:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592654.141597:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225921792:0@lo:103: 00000100:00100000:1.0:1788592654.141607:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225921408:0@lo:103: 00010000:00010000:2.0:1788592654.141685:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.141694:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.141700:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b521e00/0xbd314a3362db4a6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592654.141711:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788592654.142371:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225921280:0@lo:103: 00000100:00100000:2.0:1788592654.142456:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225922048:0@lo:103: 00000100:00100000:2.0:1788592654.142465:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225921920:0@lo:103: 00000100:00100000:3.0:1788592654.144025:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:8420:x1875475225920768:12345-0@lo:253: Request processed in 17696us (18001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592654.144039:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788592654.144235:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225920768:0@lo:253: 10000000:01000000:0.0:1788592654.144250:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788592654.144253:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592654.144255:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592654.144256:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592654.144258:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788592654.144259:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592654.144260:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592654.144262:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592654.144263:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788592654.144265:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592654.144275:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788592654.144299:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9218764b9000 from lustre-OST0000 10000000:01000000:0.0:1788592654.144326:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788592654.144329:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788592654.144336:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff921850ee4d40 local copy 10000000:01000000:0.0:1788592654.144339:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788592654.144374:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.144385:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.144395:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.144412:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922176:0@lo:101: 00000100:00100000:0.0:1788592654.144449:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.144475:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.144530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922176 00000100:00100000:1.0:1788592654.144537:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922176 00000100:00100000:1.0:1788592654.144592:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788592654.144600:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+13:8420:x1875475225922176:12345-0@lo:101: 00010000:00010000:1.0:1788592654.144611:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592654.144623:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185b520400/0xbd314a3362db4a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a75 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.144644:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185b520400/0xbd314a3362db4a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a75 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.144654:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185b520400/0xbd314a3362db4a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a75 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.144663:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185b520400, rc 0) 00000100:00100000:1.0:1788592654.144698:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922176:12345-0@lo:101: Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592654.144704:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788592654.144771:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922176:0@lo:101: 00010000:00010000:0.0:1788592654.144783:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.144791:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.144878:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922304:0@lo:501: 00000100:00100000:0.0:1788592654.144902:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.144922:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.144962:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922304 00000100:00100000:1.0:1788592654.144966:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922304 00000100:00100000:1.0:1788592654.144991:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788592654.144997:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922304:12345-0@lo:501: 00000100:00100000:1.0:1788592654.145042:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922304:12345-0@lo:501: Request processed in 46us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592654.145049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788592654.145241:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922304:0@lo:501: 10000000:01000000:0.0:1788592654.145253:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788592654.145272:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788592654.145277:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.145285:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.145292:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.145312:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788592654.145330:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9218764b9000 10000000:01000000:0.0:1788592654.145334:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788592654.145338:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788592654.145340:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592654.145344:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788592654.145346:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788592654.145361:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.145368:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.145375:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.145386:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922432:0@lo:101: 00000100:00100000:0.0:1788592654.145412:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.145432:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921846903b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.145482:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922432 00000100:00100000:1.0:1788592654.145487:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922432 00000100:00100000:1.0:1788592654.145517:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788592654.145524:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922432:12345-0@lo:101: 00010000:00010000:1.0:1788592654.145530:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592654.145544:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.145568:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.145577:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.145585:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185b520a00, rc 0) 00000100:00100000:1.0:1788592654.145613:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225922432:12345-0@lo:101: Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592654.145619:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592654.145682:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922432:0@lo:101: 00010000:00010000:0.0:1788592654.145699:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.145706:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.145760:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922560:0@lo:501: 00000100:00100000:0.0:1788592654.145782:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.145808:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921846903b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788592654.145845:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592654.145851:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.145858:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030c00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592654.145862:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.145871:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592654.145878:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592654.145883:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592654.145900:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.145906:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592654.145931:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.145938:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4a7c expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.145961:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.145963:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.145965:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592654.145972:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592654.145982:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225922688:0@lo:103: 00000100:00100000:3.0:1788592654.146010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592654.146034:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922688 00000100:00100000:3.0:1788592654.146037:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922688 00000100:00100000:3.0:1788592654.146087:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592654.146095:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3640:x1875475225922688:12345-0@lo:103: 00010000:00010000:3.0:1788592654.146104:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592654.146114:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b520400/0xbd314a3362db4a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4a75 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.146230:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592654.146267:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:3640:x1875475225922688:12345-0@lo:103: Request processed in 173us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592654.146274:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592654.146332:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922560 00000100:00100000:1.0:1788592654.146336:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922560 00000100:00100000:1.0:1788592654.146364:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592654.146370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922560:12345-0@lo:501: 00000100:00100000:1.0:1788592654.146457:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922560:12345-0@lo:501: Request processed in 87us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592654.146463:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788592654.146550:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225922688:0@lo:103: 00000100:00100000:0.0:1788592654.146585:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922560:0@lo:501: 00000100:00100000:0.0:1788592654.146610:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922816:0@lo:503: 00000100:00100000:0.0:1788592654.146806:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.146833:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921846903b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592654.146874:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922816 00000100:00100000:3.0:1788592654.146878:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922816 00000100:00100000:3.0:1788592654.146906:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788592654.146913:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922816:12345-0@lo:503: 00000100:00100000:3.0:1788592654.147060:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922816:12345-0@lo:503: Request processed in 147us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592654.147093:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788592654.147497:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922816:0@lo:503: 00000040:00080000:0.0:1788592654.147743:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592654.147814:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922944:0@lo:502: 00000100:00100000:0.0:1788592654.147853:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.147920:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921846903b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592654.148047:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225922944 00000100:00100000:3.0:1788592654.148052:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225922944 00000100:00100000:3.0:1788592654.148117:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788592654.148134:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922944:12345-0@lo:502: 00000100:00100000:3.0:1788592654.148215:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225922944:12345-0@lo:502: Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592654.148222:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788592654.148395:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225922944:0@lo:502: 00000040:00080000:0.0:1788592654.148607:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788592654.148633:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788592654.148648:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788592654.148661:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788592654.148674:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788592654.148688:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788592654.148722:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923072:0@lo:502: 00000100:00100000:0.0:1788592654.148758:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.148780:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921846903b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592654.148825:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923072 00000100:00100000:3.0:1788592654.148829:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923072 00000100:00100000:3.0:1788592654.148861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788592654.148868:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225923072:12345-0@lo:502: 00000100:00100000:3.0:1788592654.149017:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225923072:12345-0@lo:502: Request processed in 148us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592654.149024:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788592654.149216:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923072:0@lo:502: 00000040:00080000:0.0:1788592654.149257:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788592654.149264:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788592654.149726:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788592654.149734:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788592654.149741:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592654.149743:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788592654.149748:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592654.149761:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92187d7519c0) 00000020:00000080:3.0:1788592654.149782:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788592654.149788:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788592654.149857:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9218764b9000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788592654.149866:0:8443:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788592654.149873:0:8443:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd314a3362db4a98 00010000:00010000:0.0:1788592654.154998:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788592654.156407:0:8443:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788592654.164452:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788592654.164774:0:8443:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788592654.168616:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788592654.168810:0:8443:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788592654.173926:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788592654.175026:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788592654.175037:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592654.175043:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592654.175045:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788592654.175049:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592654.175053:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592654.175054:0:8443:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592654.175086:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592654.175089:0:8443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788592654.175108:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592654.175111:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592654.175112:0:8443:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788592654.175116:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788592654.177659:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788592654.177700:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788592654.177725:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.177739:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592654.177748:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218764b9000 from 1 10000000:01000000:0.0:1788592654.177751:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592654.177789:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.177797:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.177808:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592654.177830:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923200:0@lo:101: 00000100:00100000:0.0:1788592654.177896:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.177938:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921846903d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.178059:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923200 00000100:00100000:1.0:1788592654.178093:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923200 00000100:00100000:1.0:1788592654.178271:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788592654.178281:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:8420:x1875475225923200:12345-0@lo:101: 00010000:00010000:1.0:1788592654.178299:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592654.178312:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4a9f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.178333:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.178342:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592654.178350:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185b520600, rc 0) 00000100:00100000:1.0:1788592654.178393:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923200:12345-0@lo:101: Request processed in 114us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592654.178400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788592654.178480:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923200:0@lo:101: 00010000:00010000:2.0:1788592654.178497:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.178506:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592654.178604:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923328:0@lo:501: 00000100:00100000:2.0:1788592654.178630:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.178669:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592654.178751:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923328 00000100:00100000:1.0:1788592654.178756:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923328 00000100:00100000:1.0:1788592654.178789:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788592654.178796:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923328:12345-0@lo:501: 00000100:00100000:1.0:1788592654.178883:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923328:12345-0@lo:501: Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592654.178890:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788592654.178968:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923328:0@lo:501: 00000100:00100000:2.0:1788592654.178993:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923456:0@lo:503: 00000100:00100000:2.0:1788592654.179033:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.179053:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.179090:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923456 00000100:00100000:2.0:1788592654.179094:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923456 00000100:00100000:2.0:1788592654.179114:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788592654.179132:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923456:12345-0@lo:503: 00000100:00100000:2.0:1788592654.179210:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923456:12345-0@lo:503: Request processed in 89us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.179216:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788592654.179259:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923456:0@lo:503: 00000040:00080000:2.0:1788592654.179468:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592654.179534:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923584:0@lo:502: 00000100:00100000:2.0:1788592654.179581:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.179610:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.179624:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923584 00000100:00100000:2.0:1788592654.179628:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923584 00000100:00100000:2.0:1788592654.179659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592654.179665:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923584:12345-0@lo:502: 00000100:00100000:2.0:1788592654.179750:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923584:12345-0@lo:502: Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.179758:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592654.179798:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923584:0@lo:502: 00000040:00080000:2.0:1788592654.179994:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788592654.180020:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788592654.180040:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923712:0@lo:502: 00000100:00100000:2.0:1788592654.180096:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.180114:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.180127:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923712 00000100:00100000:2.0:1788592654.180130:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923712 00000100:00100000:2.0:1788592654.180148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592654.180154:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923712:12345-0@lo:502: 00000100:00100000:2.0:1788592654.180208:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923712:12345-0@lo:502: Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.180214:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592654.180244:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923712:0@lo:502: 00000040:00080000:2.0:1788592654.180273:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788592654.180279:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788592654.184353:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592654.184367:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592654.184370:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592654.184379:0:8447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9218764b9000 00000020:00000080:0.0:1788592654.184382:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592654.184393:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592654.184397:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592654.184398:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788592654.184401:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788592654.185595:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788592654.185627:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592654.185654:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.185675:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592654.185727:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788592654.185730:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9218764b9000 10000000:01000000:2.0:1788592654.185734:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9218764b9000 10000000:01000000:2.0:1788592654.185737:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592654.185742:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9218764b9000 from 1 10000000:01000000:2.0:1788592654.185744:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592654.185777:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.185786:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.185796:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592654.185817:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923840:0@lo:101: 00000100:00100000:2.0:1788592654.185881:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.185920:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.185945:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923840 00000100:00100000:2.0:1788592654.185952:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923840 00000100:00100000:2.0:1788592654.185993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788592654.186002:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8420:x1875475225923840:12345-0@lo:101: 00010000:00010000:2.0:1788592654.186014:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592654.186026:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4aad expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.186059:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4aad expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.186089:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4aad expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.186098:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cba00, rc 0) 00000100:00100000:2.0:1788592654.186333:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225923840:12345-0@lo:101: Request processed in 331us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.186341:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788592654.186448:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923840:0@lo:101: 00010000:00010000:3.0:1788592654.186464:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.186473:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592654.186577:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923968:0@lo:501: 00000100:00100000:3.0:1788592654.186605:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592654.186629:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184761c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.186732:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225923968 00000100:00100000:2.0:1788592654.186737:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225923968 00000100:00100000:2.0:1788592654.186765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788592654.186773:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225923968:12345-0@lo:501: 00000100:00100000:2.0:1788592654.186869:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225923968:12345-0@lo:501: Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.186875:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788592654.186939:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225923968:0@lo:501: 00000100:00100000:0.0:1788592654.186967:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225924096:0@lo:503: 00000100:00100000:0.0:1788592654.187008:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.187037:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592654.187139:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924096 00000100:00100000:3.0:1788592654.187143:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924096 00000100:00100000:3.0:1788592654.187171:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788592654.187177:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225924096:12345-0@lo:503: 00000100:00100000:3.0:1788592654.187247:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225924096:12345-0@lo:503: Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592654.187253:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788592654.187399:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225924096:0@lo:503: 00000040:00080000:0.0:1788592654.187614:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592654.187673:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225924224:0@lo:502: 00000100:00100000:0.0:1788592654.187708:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.187730:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.187787:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924224 00000100:00100000:2.0:1788592654.187792:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924224 00000100:00100000:2.0:1788592654.187824:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788592654.187831:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225924224:12345-0@lo:502: 00000100:00100000:2.0:1788592654.187907:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225924224:12345-0@lo:502: Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.187915:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592654.187996:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225924224:0@lo:502: 00000040:00080000:0.0:1788592654.188219:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788592654.188245:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788592654.188260:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788592654.188275:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788592654.188289:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788592654.188303:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788592654.188318:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788592654.188332:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788592654.188345:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788592654.188357:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788592654.188384:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788592654.188395:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788592654.188408:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788592654.188420:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788592654.188432:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788592654.188445:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788592654.188457:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788592654.188468:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788592654.188480:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788592654.188494:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788592654.188507:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788592654.188519:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788592654.188535:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788592654.188548:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788592654.188574:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788592654.188588:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788592654.188602:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788592654.188632:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788592654.188648:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788592654.188661:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788592654.188674:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788592654.188689:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788592654.188702:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788592654.188715:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788592654.188729:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788592654.188742:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788592654.188755:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788592654.188785:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225924352:0@lo:502: 00000100:00100000:0.0:1788592654.188828:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.188853:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.188992:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924352 00000100:00100000:2.0:1788592654.188997:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924352 00000100:00100000:2.0:1788592654.189032:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788592654.189044:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225924352:12345-0@lo:502: 00000100:00100000:2.0:1788592654.189197:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225924352:12345-0@lo:502: Request processed in 153us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.189204:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788592654.189371:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225924352:0@lo:502: 00000040:00080000:0.0:1788592654.189422:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788592654.189431:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788592654.189861:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788592654.189876:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92187d754d40) 00000020:00000080:3.0:1788592654.189897:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788592654.189978:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9218764b9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788592654.189983:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9218764b9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788592654.189985:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9218764b9000 3 00010000:00080000:3.0:1788592654.190019:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92187d590800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592654.192487:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788592654.192733:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788592654.192773:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788592654.192784:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbd314a3362db4ac2 00000100:00080000:3.0:1788592654.192794:0:8448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592654.192799:0:8448:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92187d590800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592654.192830:0:8448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875ab8380 x1875475225924480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592654.192855:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788592654.192991:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225924992:0@lo:400: 00000100:00100000:2.0:1788592654.193045:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.193106:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592654.193112:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225924608:0@lo:400: 00000100:00100000:2.0:1788592654.193247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.193283:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225924864:0@lo:400: 00000100:00100000:2.0:1788592654.193306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.193324:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592654.193329:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225924736:0@lo:400: 00000100:00100000:2.0:1788592654.193347:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.193380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924992 00000100:00100000:2.0:1788592654.193386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924992 00000100:00100000:2.0:1788592654.193422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924608 00000100:00100000:2.0:1788592654.193425:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924608 00000100:00100000:2.0:1788592654.193441:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592654.193449:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225924992:12345-0@lo:400: 00000100:00100000:2.0:1788592654.193499:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225924992:12345-0@lo:400: Request processed in 49us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.193506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592654.193518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592654.193524:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225924608:12345-0@lo:400: 00000100:00100000:2.0:1788592654.193546:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225924608:12345-0@lo:400: Request processed in 23us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.193571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592654.193592:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924864 00000100:00100000:2.0:1788592654.193595:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924864 00000100:00100000:2.0:1788592654.193615:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924736 00000100:00100000:2.0:1788592654.193617:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924736 00000100:00100000:2.0:1788592654.193629:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592654.193633:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225924864:12345-0@lo:400: 00000100:00100000:2.0:1788592654.193667:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225924864:12345-0@lo:400: Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.193672:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592654.193683:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592654.193689:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225924736:12345-0@lo:400: 00000100:00100000:2.0:1788592654.193714:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225924736:12345-0@lo:400: Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.193720:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592654.193773:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225924736:0@lo:400: 00000100:00100000:2.0:1788592654.193782:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225924864:0@lo:400: 00010000:00080000:2.0:1788592654.193913:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92186b9f2300 x1875475225924608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592654.193924:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225924608:0@lo:400: 00010000:00080000:2.0:1788592654.193934:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92186b9f0700 x1875475225924992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592654.193941:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225924992:0@lo:400: 00000100:00100000:0.0:1788592654.194091:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475225924480:0@lo:38: 00000100:00100000:0.0:1788592654.194474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.194575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225924480 00000100:00100000:2.0:1788592654.194585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225924480 00000100:00100000:2.0:1788592654.194616:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592654.194621:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475225924480:12345-0@lo:38: 00010000:00080000:2.0:1788592654.194641:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1788592654.194669:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbd314a3362db4ac9 00000004:00100000:2.0:1788592654.194683:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592654.194713:0:6512:0:(import.c:65:import_set_state_nolock()) ffff921742494800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592654.194757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875475225924480:12345-0@lo:38: Request processed in 135us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.194763:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788592654.194794:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921875ab8380 x1875475225924480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592654.194803:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592654.194809:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788592654.194815:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788592654.194820:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788592654.194822:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788592654.194827:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475225924480:0@lo:38: 00000020:01000004:2.0:1788592654.195289:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788592654.195303:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff92187d78b380) 00000020:00000080:2.0:1788592654.195320:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788592654.195406:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9218764b9000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788592654.195410:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9218764b9000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788592654.195413:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9218764b9000 3 00010000:00080000:2.0:1788592654.195448:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921742495000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592654.202058:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788592654.208988:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788592654.209046:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592654.209057:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbd314a3362db4ad7 00000100:00080000:2.0:1788592654.209088:0:8448:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592654.209095:0:8448:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff921742495000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592654.211241:0:8448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186b9f0700 x1875475225925120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592654.211268:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1788592654.211509:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788592654.211575:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788592654.211615:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592654.211634:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592654.211645:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592654.211692:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592654.211695:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592654.211696:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592654.211698:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592654.211699:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592654.211701:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592654.211703:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592654.211705:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592654.211707:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592654.211708:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592654.211709:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592654.211714:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000100:00100000:3.0:1788592654.211715:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1875475225925120:0@lo:38: 00000020:01000004:0.0:1788592654.211717:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592654.211720:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592654.211723:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592654.211724:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592654.211725:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592654.211727:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592654.211728:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592654.211729:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592654.211730:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592654.211731:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592654.211732:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592654.211755:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788592654.211767:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225925248:0@lo:253: 00000100:00100000:3.0:1788592654.211793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.211809:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592654.211838:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.212766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925120 00000100:00100000:2.0:1788592654.212774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925120 00000100:00100000:2.0:1788592654.212844:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592654.212853:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475225925120:12345-0@lo:38: 00010000:00080000:2.0:1788592654.212879:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1788592654.212921:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbd314a3362db4ade 00000004:00100000:2.0:1788592654.212936:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592654.212969:0:6513:0:(import.c:65:import_set_state_nolock()) ffff921742493800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592654.213032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875475225925120:12345-0@lo:38: Request processed in 179us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.213040:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592654.213455:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925248 00000100:00100000:2.0:1788592654.213461:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925248 00000100:00100000:2.0:1788592654.213492:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788592654.213499:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225925248:12345-0@lo:253: 20000000:01000000:2.0:1788592654.213520:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788592654.213532:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788592654.213768:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92186b9f0700 x1875475225925120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592654.213792:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592654.213800:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788592654.213808:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788592654.213813:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788592654.213816:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921742495000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788592654.213824:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1875475225925120:0@lo:38: 20000000:01000000:2.0:1788592654.217920:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788592654.217941:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788592654.219955:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:8420:x1875475225925248:12345-0@lo:253: Request processed in 6442us (8131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.219973:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788592654.220275:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8420:1875475225925248:0@lo:253: 10000000:01000000:0.0:1788592654.220292:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788592654.220295:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592654.220297:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592654.220298:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592654.220299:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592654.220300:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592654.220301:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592654.220303:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592654.220304:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592654.220305:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592654.220306:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592654.220307:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788592654.220323:0:8420:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788592654.220731:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592654.220737:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592654.220757:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.220773:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.220781:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.220789:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.220823:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.220867:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 15 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592654.220892:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225925376:0@lo:104: 00000100:00100000:3.0:1788592654.220935:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592654.220971:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592654.220979:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592654.220987:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225925504:0@lo:104: 00000100:00100000:3.0:1788592654.221005:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184761ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592654.221101:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788592654.221118:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.221146:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925376 00000100:00100000:2.0:1788592654.221152:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925376 00000100:00100000:2.0:1788592654.221180:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925504 00000100:00100000:2.0:1788592654.221182:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925504 00000100:00100000:2.0:1788592654.221193:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592654.221201:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6528:x1875475225925376:12345-0@lo:104: 00010000:00010000:2.0:1788592654.221212:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221258:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592654.221265:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6528:x1875475225925376:12345-0@lo:104: Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.221271:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592654.221306:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592654.221319:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225925504:12345-0@lo:104: 00010000:00010000:2.0:1788592654.221327:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221362:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592654.221368:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225925504:12345-0@lo:104: Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.221373:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592654.221400:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225925376:0@lo:104: 00000100:00100000:2.0:1788592654.221408:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225925504:0@lo:104: 00010000:00010000:2.0:1788592654.221423:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221440:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592654.221445:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221452:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030a00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592654.221456:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221465:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592654.221472:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592654.221478:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592654.221506:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221519:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592654.221538:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221545:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840030a00/0xbd314a3362db4a3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a44 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221570:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592654.221573:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221579:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592654.221582:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221588:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592654.221595:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592654.221599:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592654.221612:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221618:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592654.221631:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221637:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a28 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221654:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592654.221656:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592654.221657:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592654.221675:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225925632:0@lo:103: 00000100:00100000:2.0:1788592654.221703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.221736:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225925760:0@lo:103: 00000100:00100000:2.0:1788592654.221757:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592654.221789:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925632 00000100:00100000:2.0:1788592654.221793:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925632 00010000:00010000:2.0:1788592654.221816:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 16 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592654.221835:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925760 00000100:00100000:2.0:1788592654.221837:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925760 00010000:00010000:2.0:1788592654.221847:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 17 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592654.221859:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592654.221865:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:3640:x1875475225925632:12345-0@lo:103: 00010000:00010000:2.0:1788592654.221874:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592654.221878:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 17 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221886:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 17 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221899:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821ca600/0xbd314a3362db4a44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4a3d expref: 17 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221921:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592654.221949:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3640:x1875475225925632:12345-0@lo:103: Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.221955:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592654.221968:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592654.221973:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3641:x1875475225925760:12345-0@lo:103: 00010000:00010000:2.0:1788592654.221981:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592654.221984:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.221992:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222001:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840030600/0xbd314a3362db4a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4a21 expref: 15 pid: 6507 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222011:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222018:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592654.222029:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013569569s 00010000:00010000:2.0:1788592654.222033:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222040:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222055:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222061:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222084:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592654.222088:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222096:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222108:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222117:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592654.222143:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:3641:x1875475225925760:12345-0@lo:103: Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592654.222150:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788592654.222172:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222179:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592654.222186:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f800/0xbd314a3362db4ae5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592654.222209:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225925760:0@lo:103: 00000100:00100000:2.0:1788592654.222253:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225925632:0@lo:103: 00010000:00010000:1.0:1788592654.223227:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788592654.225961:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788592654.228285:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788592654.230802:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788592654.231136:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788592654.231399:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788592654.231612:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788592654.233496:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788592654.241867:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788592654.241876:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788592654.241912:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592654.241952:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592654.241975:0:8420:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788592654.241994:0:8420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788592654.242889:0:8420:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592654.243118:0:8420:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788592654.266473:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788592655.010535:0:8504:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592655.010781:0:8504:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788592655.288777:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788592655.993148:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788592655.993157:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921875948800 from 30 10000000:01000000:2.0:1788592655.993163:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592655.993659:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592655.993672:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592655.993684:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592655.993708:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225925888:0@lo:101: 00000100:00100000:2.0:1788592655.993774:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592655.993826:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592655.993853:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225925888 00000100:00100000:3.0:1788592655.993865:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225925888 00000100:00100000:3.0:1788592655.993924:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788592655.993935:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:6509:x1875475225925888:12345-0@lo:101: 00010000:00010000:3.0:1788592655.993957:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592655.993970:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4aec expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592655.993994:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4aec expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592655.994023:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4aec expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592655.994032:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205fa00, rc 0) 00000100:00100000:3.0:1788592655.994092:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225925888:12345-0@lo:101: Request processed in 159us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592655.994097:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788592655.994613:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225925888:0@lo:101: 00010000:00010000:0.0:1788592655.994631:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592655.994643:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592655.994715:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926016:0@lo:501: 00000100:00100000:0.0:1788592655.994752:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592655.994786:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845433a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592655.994792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926016 00000100:00100000:1.0:1788592655.994798:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926016 00000100:00100000:1.0:1788592655.994839:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788592655.994851:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225926016:12345-0@lo:501: 00000100:00100000:1.0:1788592655.994967:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225926016:12345-0@lo:501: Request processed in 119us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592655.994988:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788592655.996512:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926016:0@lo:501: 00000100:00100000:0.0:1788592655.996571:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926144:0@lo:503: 00000100:00100000:0.0:1788592655.996627:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592655.996671:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845433a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592655.996692:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926144 00000100:00100000:0.0:1788592655.996697:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926144 00000100:00100000:0.0:1788592655.996731:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788592655.996738:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225926144:12345-0@lo:503: 00000100:00100000:0.0:1788592655.996850:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225926144:12345-0@lo:503: Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592655.996857:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788592655.996903:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926144:0@lo:503: 00000100:00100000:0.0:1788592656.000351:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8576:1875475225926272:0@lo:502: 00000100:00100000:0.0:1788592656.000440:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592656.000526:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218454339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.004399:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926272 00000100:00100000:1.0:1788592656.004413:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926272 00000100:00100000:0.0:1788592656.006457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788592656.006469:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8576:x1875475225926272:12345-0@lo:502: 00000100:00100000:0.0:1788592656.006651:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8576:x1875475225926272:12345-0@lo:502: Request processed in 183us (6212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592656.006661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592656.010237:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8576:1875475225926272:0@lo:502: 00000100:00100000:3.0:1788592656.010315:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8576:1875475225926400:0@lo:502: 00000100:00100000:3.0:1788592656.010386:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592656.010420:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592656.012151:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926400 00000100:00100000:0.0:1788592656.012165:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926400 00000100:00100000:0.0:1788592656.012225:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788592656.012236:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8576:x1875475225926400:12345-0@lo:502: 00000100:00100000:0.0:1788592656.012388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:8576:x1875475225926400:12345-0@lo:502: Request processed in 152us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592656.012397:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788592656.012410:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8576:1875475225926400:0@lo:502: 00000040:00080000:3.0:1788592656.012457:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788592656.012865:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788592656.012887:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592656.012897:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592656.012908:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592656.012918:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788592656.012920:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921875948800 from 5 10000000:01000000:0.0:1788592656.012923:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788592656.012952:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592656.012960:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592656.012980:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592656.012997:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926528:0@lo:101: 00000100:00100000:0.0:1788592656.013032:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592656.013089:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845433300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.018336:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926528 00000100:00100000:2.0:1788592656.018349:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926528 00000100:00100000:2.0:1788592656.018404:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788592656.018417:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225926528:12345-0@lo:101: 00010000:00010000:2.0:1788592656.018432:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592656.018451:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4afa expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.018476:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4afa expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.018502:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4afa expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.018512:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca200, rc 0) 00000100:00100000:2.0:1788592656.018595:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225926528:12345-0@lo:101: Request processed in 182us (5562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592656.018603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788592656.018626:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926528:0@lo:101: 00010000:00010000:1.0:1788592656.018642:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.018653:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.018733:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926656:0@lo:256: 00000100:00100000:1.0:1788592656.018780:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.018814:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.018825:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926656 00000100:00100000:2.0:1788592656.018831:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926656 00000100:00100000:2.0:1788592656.018865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788592656.018872:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225926656:12345-0@lo:256: 20000000:01000000:2.0:1788592656.018885:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788592656.018899:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788592656.018911:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788592656.019020:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225926656:12345-0@lo:256: Request processed in 147us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592656.019028:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788592656.019032:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926656:0@lo:256: 10000000:01000000:1.0:1788592656.019098:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592656.019105:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.019114:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592656.019123:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788592656.019125:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788592656.019128:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788592656.019148:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.019155:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.019171:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.019182:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926784:0@lo:101: 00000100:00100000:1.0:1788592656.019210:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.019229:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.019500:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926784 00000100:00100000:2.0:1788592656.019505:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926784 00000100:00100000:2.0:1788592656.019554:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788592656.019564:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225926784:12345-0@lo:101: 00010000:00010000:2.0:1788592656.019572:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592656.019582:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4b08 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.019599:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.019620:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.019628:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cbc00, rc 0) 00000100:00100000:2.0:1788592656.019667:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225926784:12345-0@lo:101: Request processed in 105us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592656.019674:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788592656.019690:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926784:0@lo:101: 00010000:00010000:1.0:1788592656.019708:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.019717:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.019774:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926912:0@lo:501: 00000100:00100000:1.0:1788592656.019807:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.019851:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.019889:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225926912 00000100:00100000:3.0:1788592656.019893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225926912 00000100:00100000:3.0:1788592656.019919:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788592656.019927:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225926912:12345-0@lo:501: 00000100:00100000:3.0:1788592656.020088:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225926912:12345-0@lo:501: Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.020096:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788592656.020109:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225926912:0@lo:501: 00000100:00100000:1.0:1788592656.020141:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225927040:0@lo:503: 00000100:00100000:1.0:1788592656.020181:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.020206:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.020498:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927040 00000100:00100000:3.0:1788592656.020501:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927040 00000100:00100000:3.0:1788592656.020528:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788592656.020533:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225927040:12345-0@lo:503: 00000100:00100000:3.0:1788592656.020623:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225927040:12345-0@lo:503: Request processed in 89us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.020631:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788592656.020633:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225927040:0@lo:503: 00000100:00100000:3.0:1788592656.024819:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8578:1875475225927168:0@lo:502: 00000100:00100000:3.0:1788592656.024902:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592656.024990:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff921867af1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.025506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927168 00000100:00100000:1.0:1788592656.025514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927168 00000100:00100000:3.0:1788592656.026321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788592656.026330:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:8578:x1875475225927168:12345-0@lo:502: 00000100:00100000:3.0:1788592656.026553:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:8578:x1875475225927168:12345-0@lo:502: Request processed in 223us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.026570:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788592656.026634:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8578:1875475225927168:0@lo:502: 00000020:01000000:3.0:1788592656.026667:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788592656.026675:0:8578:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788592656.026748:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592656.026751:0:8578:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788592656.026758:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788592656.026762:0:8578:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:3.0:1788592656.026797:0:8578:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788592656.026800:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592656.026816:0:8578:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff92187d750000) 00000020:00000080:3.0:1788592656.026839:0:8578:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788592656.026846:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788592656.026924:0:8578:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788592656.026931:0:8578:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788592656.026938:0:8578:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db4b1d 00010000:00080000:3.0:1788592656.026976:0:8578:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921876711000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592656.027343:0:8578:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788592656.038669:0:8578:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788592656.038706:0:8578:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788592656.038892:0:8578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592656.039263:0:8578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592656.039353:0:8578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788592656.039515:0:8578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788592656.041346:0:8581:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592656.041352:0:8581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788592656.042655:0:8578:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788592656.042669:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788592656.043236:0:8578:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788592656.043264:0:8578:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db4b24 00000100:00080000:3.0:1788592656.043274:0:8578:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592656.043279:0:8578:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff921876711000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592656.043312:0:8578:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875ab8e00 x1875475225927296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592656.043342:0:8578:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788592656.043564:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475225927424:0@lo:400: 00000100:00100000:1.0:1788592656.043626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.043667:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475225927936:0@lo:400: 00000100:00100000:1.0:1788592656.043814:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.043834:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592656.043840:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225927808:0@lo:400: 00000100:00100000:1.0:1788592656.043858:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.043881:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225927552:0@lo:400: 00000100:00100000:1.0:1788592656.043903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.043918:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225928064:0@lo:400: 00000100:00100000:1.0:1788592656.043935:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.043945:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592656.043949:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225927680:0@lo:400: 00000100:00100000:1.0:1788592656.043966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.043998:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927424 00000100:00100000:1.0:1788592656.044004:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927424 00000100:00100000:1.0:1788592656.044034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927936 00000100:00100000:1.0:1788592656.044037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927936 00000100:00100000:1.0:1788592656.044057:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927808 00000100:00100000:1.0:1788592656.044060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927808 00000100:00100000:1.0:1788592656.044094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928064 00000100:00100000:1.0:1788592656.044096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928064 00000020:01000000:3.0:1788592656.044238:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592656.044244:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592656.044246:0:8578:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788592656.044249:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592656.044252:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592656.044254:0:8578:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592656.044257:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592656.044258:0:8578:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788592656.044284:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8578:1875475225928192:0@lo:502: 00000100:00100000:3.0:1788592656.044324:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592656.044348:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928192 00000100:00100000:3.0:1788592656.044351:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928192 00000100:00100000:0.0:1788592656.044463:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475225927296:0@lo:8: 00000100:00100000:0.0:1788592656.044499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592656.044536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592656.044551:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592656.046014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592656.046032:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475225927424:12345-0@lo:400: 00000100:00100000:1.0:1788592656.046587:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475225927424:12345-0@lo:400: Request processed in 560us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.046595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592656.046629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788592656.046637:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475225927936:12345-0@lo:400: 00000100:00100000:1.0:1788592656.046669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475225927936:12345-0@lo:400: Request processed in 33us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.046694:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788592656.046706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592656.046712:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225927808:12345-0@lo:400: 00000100:00100000:1.0:1788592656.046739:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225927808:12345-0@lo:400: Request processed in 27us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.046744:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592656.046753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788592656.046759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225928064:12345-0@lo:400: 00000100:00100000:1.0:1788592656.046785:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225928064:12345-0@lo:400: Request processed in 27us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.046791:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788592656.046829:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927552 00000100:00100000:1.0:1788592656.046835:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927552 00000100:00100000:1.0:1788592656.046860:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927680 00000100:00100000:1.0:1788592656.046863:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927680 00000100:00100000:1.0:1788592656.046873:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592656.046878:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225927552:12345-0@lo:400: 00000100:00100000:1.0:1788592656.046905:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225927552:12345-0@lo:400: Request processed in 27us (3001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.046911:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592656.046919:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788592656.046924:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225927680:12345-0@lo:400: 00000100:00100000:1.0:1788592656.046944:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225927680:12345-0@lo:400: Request processed in 20us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.046949:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788592656.047058:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225927680:0@lo:400: 00000100:00100000:1.0:1788592656.047091:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225927552:0@lo:400: 00010000:00080000:1.0:1788592656.047103:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd9880 x1875475225928064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.047125:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225928064:0@lo:400: 00010000:00080000:1.0:1788592656.047169:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dda680 x1875475225927808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.047178:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225927808:0@lo:400: 00010000:00080000:1.0:1788592656.047187:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8380 x1875475225927424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.047195:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475225927424:0@lo:400: 00010000:00080000:1.0:1788592656.047203:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741ddaa00 x1875475225927936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.047211:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475225927936:0@lo:400: 00000100:00100000:3.0:1788592656.048622:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788592656.048636:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:8578:x1875475225928192:12345-0@lo:502: 00000100:00100000:3.0:1788592656.048770:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:8578:x1875475225928192:12345-0@lo:502: Request processed in 138us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.048778:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788592656.051850:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225927296 00000100:00100000:3.0:1788592656.051861:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225927296 00000100:00100000:3.0:1788592656.051936:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592656.051944:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475225927296:12345-0@lo:8: 00010000:00080000:3.0:1788592656.051974:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1788592656.052001:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db4b2b 00002000:00100000:3.0:1788592656.052040:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff921876711800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788592656.052044:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788592656.052048:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788592656.052274:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788592656.052549:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788592656.052573:0:8427:0:(import.c:65:import_set_state_nolock()) ffff921876717000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592656.052695:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875475225927296:12345-0@lo:8: Request processed in 749us (8195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.052703:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788592656.057303:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875ab8e00 x1875475225927296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592656.057318:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592656.057328:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788592656.057335:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788592656.057341:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788592656.057343:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921876711000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788592656.057367:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788592656.057373:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475225927296:0@lo:8: 00000100:00100000:2.0:1788592656.057444:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225928320:0@lo:700: 00000100:00100000:2.0:1788592656.057497:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592656.057522:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.057559:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928320 00000100:00100000:2.0:1788592656.057564:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928320 00000100:00100000:2.0:1788592656.057607:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592656.057615:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8583:x1875475225928320:12345-0@lo:700: 00000100:00100000:2.0:1788592656.057645:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1875475225928448:0@lo:700: 00000100:00100000:2.0:1788592656.057671:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592656.057969:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55d780 going to sleep for 11 seconds 00000100:00080000:2.0:1788592656.057980:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788592656.058286:0:8581:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788592656.058353:0:8581:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 190305285563ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788592656.058359:0:8581:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788592656.058395:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fee3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.058413:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8578:1875475225928192:0@lo:502: 00000020:01000000:3.0:1788592656.058444:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592656.058450:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592656.058452:0:8578:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788592656.058458:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000004:00080000:2.0:1788592656.061858:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788592656.062149:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928448 00000100:00100000:1.0:1788592656.062159:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928448 00000100:00100000:1.0:1788592656.062238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592656.062247:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1875475225928448:12345-0@lo:700: 00000020:01000000:1.0:1788592656.062357:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788592656.062386:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788592656.062396:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.062407:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592656.062428:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788592656.062431:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921846c66000 from 30 10000000:01000000:1.0:1788592656.062433:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788592656.062463:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.062472:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.062482:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.062500:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225928576:0@lo:101: 00000100:00100000:1.0:1788592656.062570:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.062602:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.063267:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928576 00000100:00100000:2.0:1788592656.063274:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928576 00000100:00100000:2.0:1788592656.063305:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592656.063311:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225928576:12345-0@lo:101: 00010000:00010000:2.0:1788592656.063321:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592656.063333:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4b32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.063355:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.063366:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592656.063375:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca600, rc 0) 00000100:00100000:2.0:1788592656.063420:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225928576:12345-0@lo:101: Request processed in 108us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592656.063426:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788592656.063709:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225928576:0@lo:101: 00010000:00010000:1.0:1788592656.063724:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.063734:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.063788:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225928704:0@lo:501: 00000100:00100000:1.0:1788592656.063816:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.063843:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.063923:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928704 00000100:00100000:3.0:1788592656.063927:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928704 00000100:00100000:3.0:1788592656.063957:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788592656.063964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225928704:12345-0@lo:501: 00000100:00100000:3.0:1788592656.064058:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225928704:12345-0@lo:501: Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.064085:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788592656.077473:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225928704:0@lo:501: 00000100:00100000:1.0:1788592656.077530:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225928832:0@lo:503: 00000100:00100000:1.0:1788592656.077619:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.077653:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.077674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928832 00000100:00100000:1.0:1788592656.077679:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928832 00000100:00100000:1.0:1788592656.077722:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788592656.077731:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225928832:12345-0@lo:503: 00000100:00100000:1.0:1788592656.077834:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225928832:12345-0@lo:503: Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.077841:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788592656.077885:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225928832:0@lo:503: 00000100:00100000:1.0:1788592656.078052:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8585:1875475225928960:0@lo:502: 00000100:00100000:1.0:1788592656.078113:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.078133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225928960 00000100:00100000:1.0:1788592656.078136:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225928960 00000100:00100000:1.0:1788592656.078157:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788592656.078163:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:8585:x1875475225928960:12345-0@lo:502: 00000100:00100000:1.0:1788592656.078229:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:8585:x1875475225928960:12345-0@lo:502: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.078235:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788592656.078260:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.078270:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8585:1875475225928960:0@lo:502: 00000100:00100000:1.0:1788592656.078301:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8585:1875475225929088:0@lo:502: 00000100:00100000:1.0:1788592656.078327:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.078344:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929088 00000100:00100000:1.0:1788592656.078347:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929088 00000100:00100000:1.0:1788592656.078366:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788592656.078379:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:8585:x1875475225929088:12345-0@lo:502: 00000100:00100000:1.0:1788592656.078433:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:8585:x1875475225929088:12345-0@lo:502: Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.078439:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788592656.078465:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.078476:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8585:1875475225929088:0@lo:502: 00000040:00080000:1.0:1788592656.078494:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788592656.078553:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788592656.078572:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592656.078581:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078591:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592656.078600:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788592656.078602:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921846c66000 from 5 10000000:01000000:1.0:1788592656.078605:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788592656.078627:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078637:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078646:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.078657:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929216:0@lo:101: 00000100:00100000:1.0:1788592656.078679:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.078696:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.078706:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929216 00000100:00100000:1.0:1788592656.078710:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929216 00000100:00100000:1.0:1788592656.078730:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788592656.078736:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225929216:12345-0@lo:101: 00010000:00010000:1.0:1788592656.078743:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592656.078755:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4b40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078773:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078782:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078791:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185b521c00, rc 0) 00000100:00100000:1.0:1788592656.078818:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225929216:12345-0@lo:101: Request processed in 82us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.078824:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788592656.078849:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929216:0@lo:101: 00010000:00010000:1.0:1788592656.078861:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.078870:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.078911:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929344:0@lo:256: 00000100:00100000:1.0:1788592656.078940:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.078952:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.078969:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929344 00000100:00100000:1.0:1788592656.078972:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929344 00000100:00100000:1.0:1788592656.078991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788592656.078997:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225929344:12345-0@lo:256: 20000000:01000000:1.0:1788592656.079008:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788592656.079022:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788592656.079025:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788592656.079102:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225929344:12345-0@lo:256: Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.079108:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788592656.079132:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929344:0@lo:256: 10000000:01000000:1.0:1788592656.079165:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592656.079170:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079178:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592656.079185:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788592656.079186:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788592656.079188:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788592656.079200:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079208:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079216:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.079234:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929472:0@lo:101: 00000100:00100000:1.0:1788592656.079254:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.079264:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.079274:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929472 00000100:00100000:1.0:1788592656.079277:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929472 00000100:00100000:1.0:1788592656.079295:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788592656.079300:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225929472:12345-0@lo:101: 00010000:00010000:1.0:1788592656.079306:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592656.079313:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4b4e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079325:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079333:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079340:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185b521800, rc 0) 00000100:00100000:1.0:1788592656.079362:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225929472:12345-0@lo:101: Request processed in 62us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.079367:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788592656.079392:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929472:0@lo:101: 00010000:00010000:1.0:1788592656.079402:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.079410:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.079462:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929600:0@lo:501: 00000100:00100000:1.0:1788592656.079486:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.079499:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.079510:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929600 00000100:00100000:1.0:1788592656.079512:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929600 00000100:00100000:1.0:1788592656.079531:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788592656.079536:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225929600:12345-0@lo:501: 00000100:00100000:1.0:1788592656.079638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225929600:12345-0@lo:501: Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.079650:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788592656.079679:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929600:0@lo:501: 00000100:00100000:1.0:1788592656.079702:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929728:0@lo:503: 00000100:00100000:1.0:1788592656.079735:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.079747:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.079758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929728 00000100:00100000:1.0:1788592656.079762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929728 00000100:00100000:1.0:1788592656.079781:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788592656.079786:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225929728:12345-0@lo:503: 00000100:00100000:1.0:1788592656.079851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225929728:12345-0@lo:503: Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.079857:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788592656.079893:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225929728:0@lo:503: 00000100:00100000:2.0:1788592656.081187:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8586:1875475225929856:0@lo:502: 00000100:00100000:2.0:1788592656.081245:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592656.081284:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.081344:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929856 00000100:00100000:3.0:1788592656.081351:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929856 00000100:00100000:3.0:1788592656.081404:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788592656.081424:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:8586:x1875475225929856:12345-0@lo:502: 00000100:00100000:3.0:1788592656.081547:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:8586:x1875475225929856:12345-0@lo:502: Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.081556:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788592656.081571:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8586:1875475225929856:0@lo:502: 00000020:01000000:2.0:1788592656.081601:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592656.081608:0:8586:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788592656.081615:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592656.081618:0:8586:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788592656.081631:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592656.081635:0:8586:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1788592656.081657:0:8586:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788592656.081661:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592656.081675:0:8586:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92187d7899c0) 00000020:00000080:2.0:1788592656.081709:0:8586:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788592656.081717:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592656.081814:0:8586:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788592656.081820:0:8586:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788592656.081829:0:8586:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4b63 00010000:00080000:2.0:1788592656.081859:0:8586:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9218765fc800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592656.082112:0:8586:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1788592656.090214:0:8586:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788592656.090237:0:8586:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788592656.090415:0:8586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:3.0:1788592656.090436:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:2.0:1788592656.090590:0:8586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592656.090670:0:8586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788592656.090751:0:8586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788592656.093245:0:8588:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592656.093252:0:8588:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788592656.095387:0:8586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592656.095400:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788592656.095440:0:8586:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788592656.095461:0:8586:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db4b6a 00000100:00080000:2.0:1788592656.095471:0:8586:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592656.095477:0:8586:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9218765fc800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592656.095512:0:8586:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875a3c700 x1875475225929984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592656.095535:0:8586:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788592656.095602:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592656.095606:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592656.095608:0:8586:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788592656.095616:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592656.095619:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592656.095620:0:8586:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788592656.095623:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788592656.095624:0:8586:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788592656.095650:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8586:1875475225930112:0@lo:502: 00000100:00100000:2.0:1788592656.095726:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592656.095758:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592656.096426:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225929984:0@lo:8: 00000100:00100000:0.0:1788592656.096471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592656.097130:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225929984 00000100:00100000:2.0:1788592656.097137:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225929984 00000100:00100000:2.0:1788592656.097170:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592656.097177:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1875475225929984:12345-0@lo:8: 00010000:00080000:2.0:1788592656.097200:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788592656.097224:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db4b71 00002000:00100000:2.0:1788592656.097236:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92186f498000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788592656.097239:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788592656.097241:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788592656.097305:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788592656.097325:0:8429:0:(import.c:65:import_set_state_nolock()) ffff92186f49f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592656.097379:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875475225929984:12345-0@lo:8: Request processed in 201us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592656.097385:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592656.097425:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875a3c700 x1875475225929984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592656.097435:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592656.097441:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788592656.097447:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788592656.097451:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788592656.097462:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fc800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788592656.097470:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788592656.097474:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225929984:0@lo:8: 00000004:00080000:0.0:1788592656.097604:0:8588:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788592656.097641:0:8588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190344574187ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788592656.097648:0:8588:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788592656.098701:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930112 00000100:00100000:1.0:1788592656.098711:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930112 00000100:00100000:1.0:1788592656.098759:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788592656.098767:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:8586:x1875475225930112:12345-0@lo:502: 00000100:00100000:1.0:1788592656.098887:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:8586:x1875475225930112:12345-0@lo:502: Request processed in 121us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.098894:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788592656.099338:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:8586:1875475225930112:0@lo:502: 00000020:01000000:2.0:1788592656.099367:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592656.099373:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592656.099375:0:8586:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788592656.099379:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788592656.099491:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788592656.099514:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788592656.099523:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.099534:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592656.099556:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788592656.099558:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff921850ee4d40 from 1 10000000:01000000:1.0:1788592656.099561:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788592656.099587:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.099595:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.099604:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.099621:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225930240:0@lo:101: 00000100:00100000:1.0:1788592656.099658:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.099697:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592656.099700:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930240 00000100:00100000:0.0:1788592656.099706:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930240 00000100:00100000:0.0:1788592656.099742:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788592656.099750:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225930240:12345-0@lo:101: 00010000:00010000:0.0:1788592656.099759:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592656.099771:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4b78 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592656.099792:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592656.099813:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592656.099822:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030600, rc 0) 00000100:00100000:0.0:1788592656.099858:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225930240:12345-0@lo:101: Request processed in 109us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592656.099864:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788592656.100115:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225930240:0@lo:101: 00010000:00010000:1.0:1788592656.100135:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592656.100145:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592656.100202:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225930368:0@lo:501: 00000100:00100000:1.0:1788592656.100229:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.100247:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.100501:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1875475225928448:12345-0@lo:700: Request processed in 38254us (42826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.100516:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592656.101056:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f3100 x1875475225928448/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592656.101104:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1875475225928448:0@lo:700: 40000000:02000000:2.0:1788592656.101114:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788592656.103933:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930368 00000100:00100000:0.0:1788592656.103945:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930368 00000100:00100000:0.0:1788592656.104007:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788592656.104017:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225930368:12345-0@lo:501: 00000100:00100000:0.0:1788592656.104156:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225930368:12345-0@lo:501: Request processed in 141us (3926us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592656.104163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788592656.105883:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225930368:0@lo:501: 10000000:01000000:3.0:1788592656.105928:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788592656.105939:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592656.105950:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592656.106053:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788592656.106172:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225930496:0@lo:13: 00000100:00100000:1.0:1788592656.106235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788592656.106276:0:8589:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788592656.106293:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225930624:0@lo:7: 00000100:00100000:1.0:1788592656.106314:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.106337:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930624 00000100:00100000:1.0:1788592656.106343:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930624 00000100:00100000:1.0:1788592656.106397:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592656.106406:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8589:x1875475225930624:12345-0@lo:7: 00000100:00100000:3.0:1788592656.106407:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930496 00000100:00100000:3.0:1788592656.106420:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930496 00000100:00100000:3.0:1788592656.106463:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592656.106472:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875475225930496:12345-0@lo:13: 00002000:00000024:3.0:1788592656.106492:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788592656.106525:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592656.106554:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875475225930496:12345-0@lo:13: Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.106561:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788592656.106723:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788592656.107016:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8380 x1875475225930496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.107032:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225930496:0@lo:13: 00000001:00100000:0.0:1788592656.107588:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788592656.107594:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788592656.107726:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8583:x1875475225928320:12345-0@lo:700: Request processed in 50109us (50226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.107739:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788592656.108235:0:8583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f2d80 x1875475225928320/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592656.108247:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225928320:0@lo:700: 00000004:00080000:0.0:1788592656.113504:0:8583:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788592656.113534:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225930880:0@lo:7: 00000100:00100000:2.0:1788592656.113572:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592656.113589:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225930752:0@lo:13: 00000100:00100000:0.0:1788592656.113612:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592656.113648:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845433600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.113680:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.113713:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788592656.113722:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788592656.113786:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930752 00000100:00100000:0.0:1788592656.113793:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930752 00002000:00080000:3.0:1788592656.113826:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788592656.113833:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788592656.113847:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592656.113857:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225930752:12345-0@lo:13: 00002000:00000024:0.0:1788592656.113877:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788592656.113897:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8589:x1875475225930624:12345-0@lo:7: Request processed in 7491us (7580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.113907:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592656.113920:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225930752:12345-0@lo:13: Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.113926:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225930880 00000100:00100000:0.0:1788592656.113930:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592656.113932:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225930880 00000100:00100000:3.0:1788592656.113965:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592656.113973:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8583:x1875475225930880:12345-0@lo:7: 00010000:00080000:2.0:1788592656.114115:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b5180 x1875475225930752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788592656.114278:0:8589:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd9880 x1875475225930624/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592656.114289:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225930624:0@lo:7: 00000004:00080000:0.0:1788592656.114300:0:8589:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788592656.114322:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225931008:0@lo:5: 00000100:00100000:0.0:1788592656.114346:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592656.114369:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185880a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.114406:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931008 00000100:00100000:1.0:1788592656.114411:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931008 00000100:00100000:1.0:1788592656.114447:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592656.114453:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8589:x1875475225931008:12345-0@lo:5: 00002000:00080000:1.0:1788592656.114470:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788592656.114473:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788592656.114766:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8589:x1875475225931008:12345-0@lo:5: Request processed in 313us (419us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788592656.114773:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788592656.114797:0:8589:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b5880 x1875475225931008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.114809:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225931008:0@lo:5: 00000004:00080000:1.0:1788592656.114817:0:8589:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788592656.114839:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225931136:0@lo:700: 00000100:00100000:1.0:1788592656.114862:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.114878:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592656.118427:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225930752:0@lo:13: 00000100:00100000:2.0:1788592656.118486:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931136 00000100:00100000:2.0:1788592656.118493:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931136 00000100:00100000:2.0:1788592656.118556:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592656.118566:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8589:x1875475225931136:12345-0@lo:700: 00000001:00080000:1.0:1788592656.124413:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00002000:00080000:3.0:1788592656.127140:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788592656.127147:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788592656.127230:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8583:x1875475225930880:12345-0@lo:7: Request processed in 13254us (13615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592656.127240:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788592656.127427:0:8583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b6680 x1875475225930880/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592656.127443:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225930880:0@lo:7: 00000004:00080000:0.0:1788592656.127456:0:8583:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788592656.127493:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225931264:0@lo:5: 00000100:00100000:0.0:1788592656.127524:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592656.127560:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185880a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592656.127619:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931264 00000100:00100000:1.0:1788592656.127626:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931264 00000100:00100000:1.0:1788592656.127704:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592656.127713:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8583:x1875475225931264:12345-0@lo:5: 00002000:00080000:1.0:1788592656.127732:0:8590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788592656.127776:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8583:x1875475225931264:12345-0@lo:5: Request processed in 64us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592656.127782:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592656.127872:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8589:x1875475225931136:12345-0@lo:700: Request processed in 9307us (13008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592656.127881:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788592656.127952:0:8583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b6680 x1875475225931264/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592656.127962:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225931264:0@lo:5: 00000004:00080000:3.0:1788592656.127971:0:8583:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788592656.127994:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225931392:0@lo:5: 00000100:00100000:3.0:1788592656.128015:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592656.128121:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186b9b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592656.128290:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931392 00000100:00100000:0.0:1788592656.128295:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931392 00000100:00100000:0.0:1788592656.128356:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592656.128363:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8583:x1875475225931392:12345-0@lo:5: 00002000:00080000:0.0:1788592656.128385:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:1.0:1788592656.130030:0:8589:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8380 x1875475225931136/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.130041:0:8589:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788592656.130054:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225931136:0@lo:700: 00000100:00100000:0.0:1788592656.131056:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8583:x1875475225931392:12345-0@lo:5: Request processed in 2690us (3036us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788592656.131094:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788592656.131104:0:8583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875ab9880 x1875475225931392/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.131116:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8583:1875475225931392:0@lo:5: 00000004:00080000:1.0:1788592656.131129:0:8583:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788592656.131168:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8583:1875475225931520:0@lo:900: 00000100:00100000:1.0:1788592656.131206:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.131234:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592656.131329:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931520 00000100:00100000:0.0:1788592656.131335:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931520 00000100:00100000:0.0:1788592656.131376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592656.131384:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8583:x1875475225931520:12345-0@lo:900: 00000100:00100000:0.0:1788592656.131438:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8583:x1875475225931520:12345-0@lo:900: Request processed in 55us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592656.131444:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788592656.131951:0:8583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8380 x1875475225931520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592656.131963:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8583:1875475225931520:0@lo:900: 00000004:02000040:1.0:1788592656.141678:0:8589:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788592656.144146:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225931648:0@lo:5: 00000100:00100000:1.0:1788592656.144209:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592656.144237:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592656.146172:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931648 00000100:00100000:0.0:1788592656.146184:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931648 00000100:00100000:0.0:1788592656.146237:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592656.146246:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8589:x1875475225931648:12345-0@lo:5: 00002000:00080000:0.0:1788592656.152166:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788592656.152187:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788592656.155605:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8589:x1875475225931648:12345-0@lo:5: Request processed in 9351us (11386us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788592656.155618:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788592656.155717:0:8589:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8380 x1875475225931648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592672 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592656.155734:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8589:1875475225931648:0@lo:5: 00000004:00080000:3.0:1788592656.155750:0:8589:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1788592656.312391:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592657.345355:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592658.232505:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225931776:0@lo:41: 00000100:00100000:1.0:1788592658.232585:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592658.239446:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592658.239468:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225931904:0@lo:41: 00000100:00100000:1.0:1788592658.239539:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592658.241240:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931776 00000100:00100000:0.0:1788592658.241252:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931776 00000100:00100000:0.0:1788592658.241299:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225931904 00000100:00100000:0.0:1788592658.241303:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225931904 00000100:00100000:0.0:1788592658.241321:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788592658.241329:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225931776:12345-0@lo:41: 00000004:00000024:0.0:1788592658.241363:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788592658.241420:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225931776:12345-0@lo:41: Request processed in 92us (8836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.241426:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788592658.241442:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592658.241448:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225931904:12345-0@lo:41: 00000004:00000024:0.0:1788592658.241477:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788592658.241508:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225931904:12345-0@lo:41: Request processed in 60us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.241513:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592658.241567:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225931776:0@lo:41: 00000100:00100000:0.0:1788592658.244339:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225931904:0@lo:41: 00010000:00010000:2.0:1788592658.362708:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592658.621780:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788592659.386102:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788592659.448211:0:8855:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592659.448429:0:8855:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1788592660.145596:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1788592660.145613:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788592660.408320:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592661.304857:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225932032:0@lo:400: 00000100:00100000:1.0:1788592661.304937:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.304985:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225932544:0@lo:400: 00000100:00100000:1.0:1788592661.305025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305045:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225933056:0@lo:400: 00000100:00100000:1.0:1788592661.305087:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305112:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788592661.305118:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225932416:0@lo:400: 00000100:00100000:1.0:1788592661.305193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305215:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225932928:0@lo:400: 00000100:00100000:1.0:1788592661.305236:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225932160:0@lo:400: 00000100:00100000:1.0:1788592661.305309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305325:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225932672:0@lo:400: 00000100:00100000:1.0:1788592661.305342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305357:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788592661.305362:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225932288:0@lo:400: 00000100:00100000:1.0:1788592661.305393:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305409:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225932800:0@lo:400: 00000100:00100000:1.0:1788592661.305427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592661.305455:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932032 00000100:00100000:1.0:1788592661.305462:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932032 00000100:00100000:1.0:1788592661.305520:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788592661.305528:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3640:x1875475225932032:12345-0@lo:400: 00000100:00100000:1.0:1788592661.305572:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3640:x1875475225932032:12345-0@lo:400: Request processed in 45us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.305587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788592661.305628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932544 00000100:00100000:1.0:1788592661.305632:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932544 00000100:00100000:1.0:1788592661.305652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932160 00000100:00100000:1.0:1788592661.305655:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932160 00000100:00100000:1.0:1788592661.305664:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932672 00000100:00100000:1.0:1788592661.305666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932672 00000100:00100000:1.0:1788592661.305694:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932800 00000100:00100000:1.0:1788592661.305697:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932800 00000100:00100000:1.0:1788592661.305711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592661.305717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225932544:12345-0@lo:400: 00000100:00100000:1.0:1788592661.305749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225932544:12345-0@lo:400: Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.305755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592661.305767:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592661.305773:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225932160:12345-0@lo:400: 00000100:00100000:1.0:1788592661.305802:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225932160:12345-0@lo:400: Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.305808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592661.305819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788592661.305824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225932672:12345-0@lo:400: 00000100:00100000:1.0:1788592661.305850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225932672:12345-0@lo:400: Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.305856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788592661.305865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592661.305871:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225932800:12345-0@lo:400: 00000100:00100000:1.0:1788592661.305895:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225932800:12345-0@lo:400: Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.305908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592661.305928:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933056 00000100:00100000:1.0:1788592661.305932:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933056 00000100:00100000:1.0:1788592661.305971:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932928 00000100:00100000:1.0:1788592661.305974:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932928 00000100:00100000:1.0:1788592661.305994:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592661.306000:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225933056:12345-0@lo:400: 00000100:00100000:1.0:1788592661.306031:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225933056:12345-0@lo:400: Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.306037:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592661.306047:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592661.306053:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225932928:12345-0@lo:400: 00000100:00100000:1.0:1788592661.306103:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225932928:12345-0@lo:400: Request processed in 50us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.306110:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592661.306126:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932416 00000100:00100000:1.0:1788592661.306130:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932416 00000100:00100000:1.0:1788592661.306150:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225932288 00000100:00100000:1.0:1788592661.306153:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225932288 00000100:00100000:1.0:1788592661.306164:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592661.306169:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225932416:12345-0@lo:400: 00000100:00100000:1.0:1788592661.306201:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225932416:12345-0@lo:400: Request processed in 26us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.306207:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592661.306218:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788592661.306271:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592661.306276:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592661.306279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592661.306652:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225933184:0@lo:13: 00000100:00100000:3.0:1788592661.306706:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788592661.306744:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92187591df80 x1875475225932800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592661.306757:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225932800:0@lo:400: 00010000:00080000:3.0:1788592661.306770:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741ddad80 x1875475225932160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592661.306778:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225932160:0@lo:400: 00010000:00080000:3.0:1788592661.306792:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92187591f480 x1875475225932672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592661.306799:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225932672:0@lo:400: 00000100:00100000:3.0:1788592661.306833:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225932416:0@lo:400: 00010000:00080000:3.0:1788592661.306842:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92187591c700 x1875475225932928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592661.306850:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788592661.306859:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225932928:0@lo:400: 00000100:00100000:3.0:1788592661.306869:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225932032:0@lo:400: 00010000:00080000:3.0:1788592661.306879:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92187591fb80 x1875475225932544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592661.306887:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225932544:0@lo:400: 00010000:00080000:3.0:1788592661.306896:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92187591d880 x1875475225933056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592661.306911:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788592661.306920:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225933056:0@lo:400: 00000100:00100000:1.0:1788592661.307731:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225932288:12345-0@lo:400: 00000100:00100000:1.0:1788592661.307804:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225932288:12345-0@lo:400: Request processed in 89us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592661.307821:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592661.308773:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225932288:0@lo:400: 00000100:00100000:3.0:1788592661.308788:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592661.308799:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225933312:0@lo:13: 00000100:00100000:3.0:1788592661.308847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592661.308889:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933184 00000100:00100000:3.0:1788592661.308895:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933184 00000100:00100000:3.0:1788592661.308923:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933312 00000100:00100000:3.0:1788592661.308926:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933312 00000100:00100000:3.0:1788592661.308938:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592661.308945:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225933184:12345-0@lo:13: 00002000:00000024:3.0:1788592661.308967:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592661.309004:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225933184:12345-0@lo:13: Request processed in 59us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592661.309010:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592661.309025:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592661.309030:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225933312:12345-0@lo:13: 00002000:00000024:3.0:1788592661.309040:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592661.309062:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225933312:12345-0@lo:13: Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592661.311295:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788592661.313183:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8d880 x1875475225933312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592661.313208:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225933312:0@lo:13: 00010000:00080000:2.0:1788592661.313222:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875ab8000 x1875475225933184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592661.313234:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225933184:0@lo:13: 00010000:00010000:2.0:1788592661.433634:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788592662.068294:0:8956:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592662.068666:0:8956:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788592662.457820:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788592662.940196:0:9004:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592662.940206:0:9004:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788592663.353654:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225933568:0@lo:41: 00000100:00100000:2.0:1788592663.353720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592663.353765:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225933440:0@lo:41: 00000100:00100000:2.0:1788592663.353788:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592663.355827:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933568 00000100:00100000:1.0:1788592663.355841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933568 00000100:00100000:1.0:1788592663.355886:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933440 00000100:00100000:1.0:1788592663.355890:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933440 00000100:00100000:1.0:1788592663.355906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592663.355914:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225933568:12345-0@lo:41: 00000004:00000024:1.0:1788592663.355948:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788592663.356017:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225933568:12345-0@lo:41: Request processed in 103us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592663.356024:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592663.356041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592663.356047:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225933440:12345-0@lo:41: 00000004:00000024:1.0:1788592663.356100:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788592663.356130:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225933440:12345-0@lo:41: Request processed in 84us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592663.356136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592663.363324:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225933568:0@lo:41: 00000100:00100000:2.0:1788592663.363346:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225933440:0@lo:41: 00010000:00010000:1.0:1788592663.483946:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592664.504340:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592665.537517:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592666.425014:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225933696:0@lo:400: 00000100:00100000:2.0:1788592666.425104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425146:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225934208:0@lo:400: 00000100:00100000:2.0:1788592666.425172:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425191:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225934720:0@lo:400: 00000100:00100000:2.0:1788592666.425213:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425236:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788592666.425249:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225934080:0@lo:400: 00000100:00100000:2.0:1788592666.425277:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425295:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225934592:0@lo:400: 00000100:00100000:2.0:1788592666.425313:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425342:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225933824:0@lo:400: 00000100:00100000:2.0:1788592666.425364:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425381:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225934336:0@lo:400: 00000100:00100000:2.0:1788592666.425525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425547:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788592666.425553:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225933952:0@lo:400: 00000100:00100000:2.0:1788592666.425575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425597:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225934464:0@lo:400: 00000100:00100000:2.0:1788592666.425618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.425645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934208 00000100:00100000:2.0:1788592666.425652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934208 00000100:00100000:2.0:1788592666.425684:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933824 00000100:00100000:2.0:1788592666.425687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933824 00000100:00100000:2.0:1788592666.425697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934336 00000100:00100000:2.0:1788592666.425699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934336 00000100:00100000:2.0:1788592666.425718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934464 00000100:00100000:2.0:1788592666.425721:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934464 00000100:00100000:2.0:1788592666.425735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592666.425743:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225934208:12345-0@lo:400: 00000100:00100000:2.0:1788592666.425789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225934208:12345-0@lo:400: Request processed in 47us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.425795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592666.425809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592666.425814:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225933824:12345-0@lo:400: 00000100:00100000:2.0:1788592666.425851:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225933824:12345-0@lo:400: Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.425859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592666.425871:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592666.425877:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225934336:12345-0@lo:400: 00000100:00100000:2.0:1788592666.425901:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225934336:12345-0@lo:400: Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.425905:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592666.426523:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933696 00000100:00100000:1.0:1788592666.426529:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933696 00000100:00100000:1.0:1788592666.426564:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788592666.426570:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3640:x1875475225933696:12345-0@lo:400: 00000100:00100000:1.0:1788592666.426606:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3640:x1875475225933696:12345-0@lo:400: Request processed in 36us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592666.426611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788592666.427234:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934080 00000100:00100000:3.0:1788592666.427240:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934080 00000100:00100000:3.0:1788592666.427276:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225933952 00000100:00100000:3.0:1788592666.427279:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225933952 00000100:00100000:3.0:1788592666.427292:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592666.427298:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225934080:12345-0@lo:400: 00000100:00100000:3.0:1788592666.427338:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225934080:12345-0@lo:400: Request processed in 40us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592666.427345:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592666.427359:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592666.427365:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225933952:12345-0@lo:400: 00000100:00100000:3.0:1788592666.427393:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225933952:12345-0@lo:400: Request processed in 28us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.427515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592666.427524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225934464:12345-0@lo:400: 00000100:00100000:2.0:1788592666.427557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225934464:12345-0@lo:400: Request processed in 35us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.427563:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788592666.427579:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592666.427583:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592666.427612:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225934976:0@lo:13: 00000100:00100000:2.0:1788592666.427643:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.427667:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592666.427673:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225934848:0@lo:13: 00000100:00100000:2.0:1788592666.427693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592666.427716:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934976 00000100:00100000:2.0:1788592666.427720:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934976 00000100:00100000:2.0:1788592666.427743:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934848 00000100:00100000:2.0:1788592666.427745:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934848 00000100:00100000:2.0:1788592666.427758:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592666.427765:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225934976:12345-0@lo:13: 00002000:00000024:2.0:1788592666.427786:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592666.427831:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225934976:12345-0@lo:13: Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.427837:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592666.427848:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592666.427855:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225934848:12345-0@lo:13: 00002000:00000024:2.0:1788592666.427863:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592666.427882:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225934848:12345-0@lo:13: Request processed in 29us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592666.427887:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788592666.427902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592666.428555:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592666.428591:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934720 00000100:00100000:3.0:1788592666.428595:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934720 00000100:00100000:3.0:1788592666.428619:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225934592 00000100:00100000:3.0:1788592666.428622:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225934592 00000100:00100000:3.0:1788592666.428637:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592666.428644:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225934720:12345-0@lo:400: 00000100:00100000:3.0:1788592666.428683:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225934720:12345-0@lo:400: Request processed in 41us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592666.428689:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592666.428700:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592666.428706:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225934592:12345-0@lo:400: 00000100:00100000:3.0:1788592666.428732:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225934592:12345-0@lo:400: Request processed in 27us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592666.428737:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788592666.429256:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875ab8000 x1875475225934848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.429275:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225934848:0@lo:13: 00010000:00080000:2.0:1788592666.429288:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8df80 x1875475225934976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.429299:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225934976:0@lo:13: 00000100:00100000:2.0:1788592666.429335:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225933952:0@lo:400: 00010000:00080000:2.0:1788592666.429347:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186f484a80 x1875475225934464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.429357:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225934464:0@lo:400: 00010000:00080000:2.0:1788592666.429368:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875a3f100 x1875475225933824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.429375:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225933824:0@lo:400: 00010000:00080000:2.0:1788592666.429386:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f3100 x1875475225934336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.430029:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225934336:0@lo:400: 00000100:00100000:2.0:1788592666.430101:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225934080:0@lo:400: 00010000:00080000:2.0:1788592666.430112:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186f487b80 x1875475225934592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.430120:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225934592:0@lo:400: 00000100:00100000:2.0:1788592666.430129:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225933696:0@lo:400: 00010000:00080000:2.0:1788592666.430139:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f2d80 x1875475225934208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.430146:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225934208:0@lo:400: 00010000:00080000:2.0:1788592666.430155:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186f487480 x1875475225934720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592666.430161:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225934720:0@lo:400: 00010000:00010000:1.0:1788592666.552377:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592667.576453:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592668.475244:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225935104:0@lo:41: 00000100:00100000:2.0:1788592668.475313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592668.475559:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935104 00000100:00100000:3.0:1788592668.475572:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935104 00000100:00100000:3.0:1788592668.475614:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592668.475621:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225935104:12345-0@lo:41: 00000004:00000024:3.0:1788592668.475652:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788592668.475691:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225935104:12345-0@lo:41: Request processed in 70us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592668.475697:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592668.475721:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225935232:0@lo:41: 00000100:00100000:3.0:1788592668.475743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592668.475776:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935232 00000100:00100000:3.0:1788592668.475779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935232 00000100:00100000:3.0:1788592668.475798:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592668.475803:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225935232:12345-0@lo:41: 00000004:00000024:3.0:1788592668.475819:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788592668.475846:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225935232:12345-0@lo:41: Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592668.475852:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592668.475888:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225935104:0@lo:41: 00000100:00100000:3.0:1788592668.475927:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225935232:0@lo:41: 00010000:00010000:1.0:1788592668.602001:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592669.633721:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592670.651752:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592671.545343:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225935488:0@lo:13: 00000100:00100000:2.0:1788592671.545408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592671.545474:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225935360:0@lo:13: 00000100:00100000:2.0:1788592671.545497:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592671.545534:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935488 00000100:00100000:2.0:1788592671.545541:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935488 00000100:00100000:2.0:1788592671.545578:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935360 00000100:00100000:2.0:1788592671.545581:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935360 00000100:00100000:0.0:1788592671.545593:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225935744:0@lo:400: 00000100:00100000:2.0:1788592671.545604:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592671.545611:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225935488:12345-0@lo:13: 00000100:00100000:0.0:1788592671.545620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788592671.545636:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592671.545638:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225936256:0@lo:400: 00000100:00100000:0.0:1788592671.545654:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592671.545667:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225935488:12345-0@lo:13: Request processed in 57us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592671.545675:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592671.545676:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788592671.545680:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225935872:0@lo:400: 00000100:00100000:2.0:1788592671.545689:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592671.545694:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225935360:12345-0@lo:13: 00000100:00100000:0.0:1788592671.545700:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788592671.545703:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592671.545720:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225936384:0@lo:400: 00000100:00100000:2.0:1788592671.545721:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225935360:12345-0@lo:13: Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592671.545727:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592671.545741:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592671.545742:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592671.545768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935744 00000100:00100000:0.0:1788592671.545772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935744 00000100:00100000:0.0:1788592671.545793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936256 00000100:00100000:0.0:1788592671.545795:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936256 00000100:00100000:0.0:1788592671.545819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936384 00000100:00100000:0.0:1788592671.545822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936384 00000100:00100000:0.0:1788592671.545834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592671.545846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225935744:12345-0@lo:400: 00000100:00100000:0.0:1788592671.545883:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225935744:12345-0@lo:400: Request processed in 38us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592671.545889:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592671.545903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592671.545909:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225936256:12345-0@lo:400: 00000100:00100000:0.0:1788592671.545935:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225936256:12345-0@lo:400: Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592671.545941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592671.545952:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788592671.545958:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225936384:12345-0@lo:400: 00000100:00100000:0.0:1788592671.545981:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225936384:12345-0@lo:400: Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592671.545987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788592671.546007:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935872 00000100:00100000:0.0:1788592671.546011:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935872 00000100:00100000:0.0:1788592671.546034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592671.546041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225935872:12345-0@lo:400: 00000100:00100000:0.0:1788592671.546102:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225935872:12345-0@lo:400: Request processed in 61us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592671.546108:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592671.546132:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225935616:0@lo:400: 00000100:00100000:0.0:1788592671.546160:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592671.546183:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225936128:0@lo:400: 00000100:00100000:0.0:1788592671.546201:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592671.546216:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592671.546503:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225936000:0@lo:400: 00000100:00100000:0.0:1788592671.546526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592671.546588:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225935616 00000100:00100000:0.0:1788592671.546592:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225935616 00000100:00100000:0.0:1788592671.546618:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788592671.546625:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3642:x1875475225935616:12345-0@lo:400: 00000100:00100000:0.0:1788592671.546655:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3642:x1875475225935616:12345-0@lo:400: Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592671.546661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788592671.546705:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225935872:0@lo:400: 00010000:00080000:0.0:1788592671.546719:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921876655880 x1875475225936384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592671.546729:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225936384:0@lo:400: 00010000:00080000:0.0:1788592671.546740:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b6680 x1875475225935744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592671.546747:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225935744:0@lo:400: 00010000:00080000:0.0:1788592671.546755:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b7b80 x1875475225936256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592671.546762:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225936256:0@lo:400: 00000100:00100000:0.0:1788592671.546792:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225935616:0@lo:400: 00010000:00080000:0.0:1788592671.546812:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186f484a80 x1875475225935488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592671.546825:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225935488:0@lo:13: 00010000:00080000:0.0:1788592671.546835:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875ab8e00 x1875475225935360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592671.546852:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225935360:0@lo:13: 00000100:00100000:0.0:1788592671.546872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936128 00000100:00100000:0.0:1788592671.546875:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936128 00000100:00100000:0.0:1788592671.546895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788592671.546901:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225936128:12345-0@lo:400: 00000100:00100000:0.0:1788592671.546932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225936128:12345-0@lo:400: Request processed in 31us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592671.546938:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788592671.546960:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9218698b6d80 x1875475225936128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592671.546969:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225936128:0@lo:400: 00000100:00100000:3.0:1788592671.547569:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936000 00000100:00100000:3.0:1788592671.547574:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936000 00000100:00100000:3.0:1788592671.547649:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592671.547657:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225936000:12345-0@lo:400: 00000100:00080000:2.0:1788592671.547697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592671.547701:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592671.547706:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225936000:12345-0@lo:400: Request processed in 50us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592671.547712:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788592671.547766:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225936000:0@lo:400: 00010000:00010000:1.0:1788592671.675706:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788592672.090390:0:9503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788592672.090394:0:9503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788592672.090396:0:9503:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788592672.090545:0:9503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92174243f000 00000020:01000004:1.0:1788592672.090561:0:9503:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788592672.090580:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788592672.090594:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92186d59cd40) 00000020:00000080:1.0:1788592672.092233:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788592672.124610:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788592672.124655:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788592672.158268:0:9503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788592672.158515:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788592672.158529:0:9503:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788592672.158541:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd314a3362db4b8d 00000020:01000004:0.0:1788592672.158547:0:9503:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788592672.158567:0:9503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788592672.158570:0:9503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788592672.158576:0:9503:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788592672.158611:0:9503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788592672.158615:0:9503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788592672.177270:0:9503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788592672.177308:0:9503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.147@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788592672.177313:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788592672.177314:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592672.177319:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592672.177321:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592672.177322:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592672.177323:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592672.177324:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592672.177325:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592672.177326:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592672.177328:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592672.177328:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788592672.177332:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788592672.177334:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592672.177335:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592672.177336:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592672.177337:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592672.177338:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592672.177339:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592672.177339:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592672.177340:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592672.177341:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592672.177342:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592672.177343:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788592672.177367:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788592672.177384:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225936512:0@lo:253: 00000100:00100000:0.0:1788592672.178675:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592672.178762:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217428470c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592672.178805:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936512 00000100:00100000:1.0:1788592672.178813:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936512 00000100:00100000:1.0:1788592672.178894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788592672.178903:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:9503:x1875475225936512:12345-0@lo:253: 20000000:01000000:1.0:1788592672.178932:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788592672.178937:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788592672.178942:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788592672.178945:0:6504:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788592672.179994:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592672.180403:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788592672.180421:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788592672.180451:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788592672.180458:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788592672.180472:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788592672.180490:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788592672.180589:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788592672.180606:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.147@tcp 20000000:01000000:1.0:1788592672.180608:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592672.180623:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788592672.180635:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788592672.180650:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788592672.180656:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592672.180668:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788592672.180674:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788592672.180687:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788592672.180702:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788592672.180769:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788592672.180780:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.147@tcp 20000000:01000000:1.0:1788592672.180782:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592672.180795:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788592672.180801:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788592672.180814:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788592672.180818:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592672.180830:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788592672.180835:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788592672.180847:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788592672.180862:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788592672.181498:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788592672.181513:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.147@tcp 20000000:01000000:1.0:1788592672.181515:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788592672.181530:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788592672.181537:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788592672.181549:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788592672.181555:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.147@tcp (null) (null) 00000040:00080000:1.0:1788592672.181568:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788592672.181575:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788592672.181588:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788592672.181608:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788592672.181621:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788592672.181630:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788592672.181634:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788592672.181675:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788592672.181677:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788592672.182369:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788592672.182639:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788592672.182663:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788592672.182679:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1788592672.182690:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788592672.182692:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788592672.182951:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788592672.182970:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788592672.182988:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788592672.183333:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788592672.183353:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788592672.183368:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788592672.183378:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788592672.183379:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788592672.183646:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788592672.183665:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788592672.183682:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788592672.183800:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788592672.183818:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788592672.183844:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788592672.183855:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788592672.183856:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788592672.184289:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788592672.184310:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788592672.184328:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788592672.184481:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788592672.184502:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788592672.184518:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788592672.184527:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788592672.184529:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788592672.184830:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788592672.184856:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788592672.184870:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788592672.185631:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788592672.185659:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788592672.185676:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:1.0:1788592672.185693:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788592672.185710:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185727:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185735:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4aad expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185743:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4aec expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185749:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185756:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185762:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185769:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185777:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185822:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.185837:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 21 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.185851:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225936640:0@lo:104: 00000100:00100000:1.0:1788592672.185911:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592672.186006:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.186016:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 21 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.186024:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225936768:0@lo:104: 00000100:00100000:1.0:1788592672.186048:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592672.186730:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.186740:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 21 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.186750:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225936896:0@lo:104: 00000100:00100000:2.0:1788592672.186779:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.186808:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936640 00000100:00100000:3.0:1788592672.186815:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936640 00000100:00100000:3.0:1788592672.186852:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936768 00000100:00100000:3.0:1788592672.186855:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936768 00000100:00100000:3.0:1788592672.186872:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592672.186880:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225936640:12345-0@lo:104: 00010000:00010000:3.0:1788592672.186893:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.186945:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592672.186951:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225936640:12345-0@lo:104: Request processed in 72us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.186959:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592672.186976:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592672.186981:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225936768:12345-0@lo:104: 00010000:00010000:3.0:1788592672.186989:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187044:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592672.187049:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225936768:12345-0@lo:104: Request processed in 69us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.187056:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788592672.187093:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592672.187099:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187106:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b520200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592672.187110:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187119:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592672.187126:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592672.187132:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592672.187161:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187168:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592672.187196:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187203:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b520200/0xbd314a3362db4b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187225:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592672.187229:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187234:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b520400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592672.187237:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187245:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592672.187251:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592672.187257:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592672.187270:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187276:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592672.187281:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187288:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b520400/0xbd314a3362db4b4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187296:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592672.187298:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592672.187300:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592672.187319:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225937024:0@lo:103: 00000100:00100000:3.0:1788592672.187352:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.187376:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592672.187382:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225937152:0@lo:103: 00000100:00100000:3.0:1788592672.187401:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.187426:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937024 00000100:00100000:3.0:1788592672.187439:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937024 00010000:00010000:3.0:1788592672.187455:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 22 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592672.187475:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937152 00000100:00100000:3.0:1788592672.187479:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937152 00010000:00010000:3.0:1788592672.187489:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 23 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592672.187502:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592672.187508:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3641:x1875475225937024:12345-0@lo:103: 00010000:00010000:3.0:1788592672.187518:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592672.187523:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 23 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187533:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 23 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187550:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592672.187578:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3641:x1875475225937024:12345-0@lo:103: Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.187584:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592672.187597:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592672.187604:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3641:x1875475225937152:12345-0@lo:103: 00010000:00010000:3.0:1788592672.187620:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592672.187625:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 22 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187634:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 22 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.187644:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592672.187671:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3641:x1875475225937152:12345-0@lo:103: Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.187678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592672.187713:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225937152:0@lo:103: 00000100:00100000:3.0:1788592672.187722:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225937024:0@lo:103: 00010000:00010000:1.0:1788592672.188708:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592672.189104:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.189118:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 21 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.189146:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937280:0@lo:104: 00000100:00100000:2.0:1788592672.189372:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592672.189574:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4aec expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.189584:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4aec expref: 21 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.189593:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937408:0@lo:104: 00000100:00100000:2.0:1788592672.189618:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.189644:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225936896 00000100:00100000:1.0:1788592672.189650:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225936896 00000100:00100000:1.0:1788592672.189678:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937280 00000100:00100000:1.0:1788592672.189681:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937280 00000100:00100000:1.0:1788592672.189693:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592672.189700:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225936896:12345-0@lo:104: 00010000:00010000:1.0:1788592672.189712:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189763:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592672.189769:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225936896:12345-0@lo:104: Request processed in 70us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.189782:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592672.189798:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592672.189805:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225937280:12345-0@lo:104: 00010000:00010000:1.0:1788592672.189813:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189847:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788592672.189852:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225937280:12345-0@lo:104: Request processed in 49us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.189858:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788592672.189874:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592672.189879:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189886:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592672.189890:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189898:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592672.189905:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592672.189911:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592672.189936:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189943:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592672.189966:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189974:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b521200/0xbd314a3362db4b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189984:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592672.189987:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.189992:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521e00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592672.189995:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.190108:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.190361:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592672.190367:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592672.190372:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592672.190388:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190394:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592672.190400:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190406:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b521e00/0xbd314a3362db4b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b0f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190415:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.190422:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.190424:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592672.190446:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225937536:0@lo:103: 00000100:00100000:1.0:1788592672.190477:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.190508:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592672.190514:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225937664:0@lo:103: 00000100:00100000:1.0:1788592672.190537:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.190564:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937536 00000100:00100000:1.0:1788592672.190568:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937536 00010000:00010000:1.0:1788592672.190584:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 22 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.190603:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937664 00000100:00100000:1.0:1788592672.190606:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937664 00010000:00010000:1.0:1788592672.190616:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 23 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.190629:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592672.190634:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3639:x1875475225937536:12345-0@lo:103: 00010000:00010000:1.0:1788592672.190643:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.190648:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 23 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190659:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 23 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190674:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.190709:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3639:x1875475225937536:12345-0@lo:103: Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.190715:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592672.190736:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592672.190742:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3639:x1875475225937664:12345-0@lo:103: 00010000:00010000:1.0:1788592672.190750:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.190755:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 22 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190763:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 22 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.190773:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.190796:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3639:x1875475225937664:12345-0@lo:103: Request processed in 54us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.190801:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592672.190913:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225937664:0@lo:103: 00000100:00100000:0.0:1788592672.190922:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225937536:0@lo:103: 00010000:00010000:2.0:1788592672.191356:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4aad expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.191367:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4aad expref: 21 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.191377:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937792:0@lo:104: 00000100:00100000:2.0:1788592672.191406:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592672.191436:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.191446:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 21 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.191454:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937920:0@lo:104: 00000100:00100000:2.0:1788592672.191472:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf540 going to sleep for 11 seconds 00010000:00010000:2.0:1788592672.191486:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840030600/0xbd314a3362db4b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4b78 expref: 21 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.191511:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225936640:0@lo:104: 00010000:00010000:2.0:1788592672.191525:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b521800/0xbd314a3362db4b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4b4e expref: 20 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.191533:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225936768:0@lo:104: 00010000:00010000:2.0:1788592672.191543:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821ca600/0xbd314a3362db4b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4b32 expref: 19 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.191552:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225936896:0@lo:104: 00010000:00010000:2.0:1788592672.191561:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821cbc00/0xbd314a3362db4b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4b08 expref: 18 pid: 6504 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.191569:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937280:0@lo:104: 00000100:00100000:0.0:1788592672.191631:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788592672.191648:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592672.191658:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937408 00000100:00100000:0.0:1788592672.191661:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937408 00000100:00100000:0.0:1788592672.191681:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937792 00000100:00100000:0.0:1788592672.191684:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937792 00000100:00100000:0.0:1788592672.191692:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225937920 00000100:00100000:0.0:1788592672.191694:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225937920 00000100:00100000:0.0:1788592672.191705:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592672.191711:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6504:x1875475225937408:12345-0@lo:104: 00010000:00010000:0.0:1788592672.191720:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.191766:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592672.191772:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:6504:x1875475225937408:12345-0@lo:104: Request processed in 62us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.191778:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592672.191792:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788592672.191798:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217425e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225937792:12345-0@lo:104: 00010000:00010000:0.0:1788592672.191811:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.191844:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788592672.191850:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217425e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:6504:x1875475225937792:12345-0@lo:104: Request processed in 52us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.191856:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788592672.191889:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788592672.191896:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225937920:12345-0@lo:104: 00010000:00010000:0.0:1788592672.191903:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.191930:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788592672.191935:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6504:x1875475225937920:12345-0@lo:104: Request processed in 40us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.191940:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788592672.191955:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788592672.191959:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.191965:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592672.191969:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.191977:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592672.191985:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592672.191997:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592672.192029:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192036:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592672.192052:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192059:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9218821cb200/0xbd314a3362db4aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4af3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192091:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592672.192095:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192100:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592672.192103:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192110:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592672.192116:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592672.192121:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592672.192134:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192141:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592672.192153:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192160:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9218821ca400/0xbd314a3362db4aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4ab4 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192169:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592672.192172:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192254:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592672.192257:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192264:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592672.192270:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592672.192276:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592672.192290:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192296:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592672.192309:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192316:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a8a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.192330:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592672.192338:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592672.192340:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592672.192351:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225938304:0@lo:103: 00000100:00100000:0.0:1788592672.192379:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.192527:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225938176:0@lo:103: 00000100:00100000:1.0:1788592672.192554:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.192582:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592672.192589:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225938048:0@lo:103: 00000100:00100000:1.0:1788592672.192609:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592672.192635:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592672.192644:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938304 00000100:00100000:1.0:1788592672.192648:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938304 00010000:00010000:1.0:1788592672.192668:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 18 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.192684:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938176 00000100:00100000:1.0:1788592672.192686:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938176 00010000:00010000:1.0:1788592672.192698:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4aad expref: 19 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.192708:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938048 00000100:00100000:1.0:1788592672.192718:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938048 00010000:00010000:1.0:1788592672.192731:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4aec expref: 20 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.192744:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592672.192749:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3639:x1875475225938304:12345-0@lo:103: 00010000:00010000:1.0:1788592672.192759:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.192764:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 20 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192774:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 20 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192788:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.192818:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3639:x1875475225938304:12345-0@lo:103: Request processed in 69us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.192825:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592672.192837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592672.192842:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3642:x1875475225938176:12345-0@lo:103: 00010000:00010000:1.0:1788592672.192850:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.192854:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4aad expref: 19 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192862:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4aad expref: 19 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192871:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.192895:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3642:x1875475225938176:12345-0@lo:103: Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.192901:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592672.192919:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592672.192925:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3642:x1875475225938048:12345-0@lo:103: 00010000:00010000:1.0:1788592672.192932:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.192937:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4aec expref: 18 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192945:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4aec expref: 18 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192957:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192965:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192979:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192987:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.192994:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.193012:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.193017:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592672.193021:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.193028:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.193043:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.193053:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.193099:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3642:x1875475225938048:12345-0@lo:103: Request processed in 174us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.193106:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592672.193134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225938048:0@lo:103: 00000100:00100000:1.0:1788592672.193141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225938176:0@lo:103: 00000100:00100000:1.0:1788592672.193169:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225938304:0@lo:103: 00010000:00010000:1.0:1788592672.193277:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592672.193424:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205fa00/0xbd314a3362db4af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4aec expref: 17 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.193447:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937408:0@lo:104: 00010000:00010000:2.0:1788592672.193458:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821cba00/0xbd314a3362db4ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4aad expref: 16 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.193466:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937792:0@lo:104: 00010000:00010000:2.0:1788592672.193473:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b520a00/0xbd314a3362db4a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4a83 expref: 15 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.193481:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875475225937920:0@lo:104: 00010000:00010000:2.0:1788592672.193505:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.193520:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.193525:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.193531:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742838000/0xbd314a3362db4b94 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592672.193543:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788592672.195844:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:9503:x1875475225936512:12345-0@lo:253: Request processed in 16934us (17164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.195858:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788592672.195968:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225936512:0@lo:253: 10000000:01000000:0.0:1788592672.195983:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788592672.195987:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592672.195988:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592672.195989:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592672.195990:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788592672.195991:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592672.195993:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592672.195994:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592672.195995:0:9503:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788592672.196052:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592672.196055:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788592672.196366:0:9503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92174243f000 from lustre-OST0001 10000000:01000000:1.0:1788592672.196396:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788592672.196399:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788592672.196407:0:9503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff921850ee4d40 local copy 10000000:01000000:1.0:1788592672.196411:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788592672.196452:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.196462:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.196471:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.196500:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938432:0@lo:101: 00000100:00100000:1.0:1788592672.196541:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.196610:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592672.196644:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938432 00000100:00100000:0.0:1788592672.196651:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938432 00000100:00100000:0.0:1788592672.196725:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788592672.196734:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+14:9503:x1875475225938432:12345-0@lo:101: 00010000:00010000:0.0:1788592672.196745:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592672.196756:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921840030c00/0xbd314a3362db4ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4b9b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.196777:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921840030c00/0xbd314a3362db4ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4b9b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.196788:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921840030c00/0xbd314a3362db4ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b9b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.196797:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030c00, rc 0) 00000100:00100000:0.0:1788592672.196837:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225938432:12345-0@lo:101: Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.196857:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788592672.196912:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938432:0@lo:101: 00010000:00010000:1.0:1788592672.196926:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.196935:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.197025:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938560:0@lo:501: 00000100:00100000:1.0:1788592672.197052:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.197420:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788592672.197500:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938560 00000100:00100000:3.0:1788592672.197505:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938560 00000100:00100000:3.0:1788592672.197530:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788592672.197536:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225938560:12345-0@lo:501: 00000100:00100000:3.0:1788592672.197602:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225938560:12345-0@lo:501: Request processed in 66us (549us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592672.197609:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788592672.197687:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938560:0@lo:501: 10000000:01000000:1.0:1788592672.197701:0:9503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788592672.197716:0:9503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788592672.197721:0:9503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.197728:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.197735:0:9503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.197757:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788592672.197786:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92174243f000 10000000:01000000:1.0:1788592672.197791:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788592672.197795:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788592672.197797:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592672.197801:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788592672.197803:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788592672.197820:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.197827:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.197834:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.197847:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938688:0@lo:101: 00000100:00100000:1.0:1788592672.197871:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.197882:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592672.197933:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938688 00000100:00100000:3.0:1788592672.197938:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938688 00000100:00100000:3.0:1788592672.197955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788592672.197960:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225938688:12345-0@lo:101: 00010000:00010000:3.0:1788592672.197967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592672.197974:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4ba9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198059:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198093:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198101:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e200, rc 0) 00000100:00100000:3.0:1788592672.198127:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225938688:12345-0@lo:101: Request processed in 167us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.198133:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:3.0:1788592672.198154:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592672.198159:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198166:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839c00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592672.198169:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.198285:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938688:0@lo:101: 00010000:00010000:1.0:1788592672.198297:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.198306:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.198359:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938816:0@lo:501: 00000100:00100000:1.0:1788592672.198384:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.198404:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788592672.198446:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592672.198455:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592672.198460:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592672.198477:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198483:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592672.198512:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198520:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742839c00/0xbd314a3362db4b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd314a3362db4ba2 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198532:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592672.198534:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592672.198536:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592672.198547:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938816 00000100:00100000:3.0:1788592672.198550:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938816 00000100:00100000:3.0:1788592672.198568:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788592672.198574:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225938816:12345-0@lo:501: 00000100:00100000:3.0:1788592672.198659:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225938816:12345-0@lo:501: Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.198665:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788592672.198686:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592672.198695:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225938944:0@lo:103: 00000100:00100000:3.0:1788592672.198720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.198747:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225938944 00000100:00100000:3.0:1788592672.198750:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225938944 00000100:00100000:3.0:1788592672.198777:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592672.198784:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3639:x1875475225938944:12345-0@lo:103: 00010000:00010000:3.0:1788592672.198793:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592672.198804:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840030c00/0xbd314a3362db4ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4b9b expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592672.198815:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592672.198842:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3639:x1875475225938944:12345-0@lo:103: Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.198854:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592672.198883:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225938944:0@lo:103: 00000100:00100000:1.0:1788592672.198952:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225938816:0@lo:501: 00000100:00100000:1.0:1788592672.198984:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939072:0@lo:503: 00000100:00100000:1.0:1788592672.199124:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.199141:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592672.199331:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939072 00000100:00100000:3.0:1788592672.199336:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939072 00000100:00100000:3.0:1788592672.199356:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788592672.199362:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939072:12345-0@lo:503: 00000100:00100000:3.0:1788592672.199625:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939072:12345-0@lo:503: Request processed in 262us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.199633:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788592672.199747:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939072:0@lo:503: 00000040:00080000:1.0:1788592672.199989:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788592672.200534:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939200:0@lo:502: 00000100:00100000:1.0:1788592672.200580:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.200646:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592672.200691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939200 00000100:00100000:2.0:1788592672.200696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939200 00000100:00100000:2.0:1788592672.200761:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788592672.200769:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939200:12345-0@lo:502: 00000100:00100000:2.0:1788592672.200861:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939200:12345-0@lo:502: Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.200868:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788592672.200937:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939200:0@lo:502: 00000040:00080000:1.0:1788592672.201173:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788592672.201212:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788592672.201227:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788592672.201241:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788592672.201252:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788592672.201265:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788592672.201285:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939328:0@lo:502: 00000100:00100000:1.0:1788592672.201317:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.201754:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592672.201828:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939328 00000100:00100000:3.0:1788592672.201833:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939328 00000100:00100000:3.0:1788592672.201864:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788592672.201871:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939328:12345-0@lo:502: 00000100:00100000:3.0:1788592672.201964:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939328:12345-0@lo:502: Request processed in 93us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.201971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788592672.202094:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939328:0@lo:502: 00000040:00080000:1.0:1788592672.202147:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788592672.202157:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788592672.202778:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788592672.202786:0:9514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788592672.202792:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592672.202795:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788592672.202800:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592672.202822:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff921742aa4d40) 00000020:00000080:3.0:1788592672.202845:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788592672.202851:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788592672.202915:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92174243f000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788592672.202923:0:9514:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788592672.202929:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd314a3362db4bbe 00010000:00010000:3.0:1788592672.210651:0:9514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788592672.210917:0:9514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788592672.213847:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788592672.214706:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788592672.219315:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788592672.219491:0:9514:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788592672.224375:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788592672.227305:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788592672.227318:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592672.227325:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592672.227327:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788592672.227332:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592672.227336:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592672.227338:0:9514:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592672.227342:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592672.227344:0:9514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788592672.227371:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592672.227374:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592672.227376:0:9514:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788592672.227379:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788592672.227556:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788592672.227585:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788592672.227609:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.227621:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592672.227630:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174243f000 from 1 10000000:01000000:2.0:1788592672.227632:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592672.227665:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.227680:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.227692:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.229139:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939456:0@lo:101: 00000100:00100000:2.0:1788592672.229266:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592672.229307:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939456 00000100:00100000:2.0:1788592672.229313:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939456 00000100:00100000:2.0:1788592672.229350:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788592672.229358:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:9503:x1875475225939456:12345-0@lo:101: 00010000:00010000:2.0:1788592672.229370:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592672.229384:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4bc5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.229406:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.229417:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.229425:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80400, rc 0) 00000100:00100000:2.0:1788592672.229461:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939456:12345-0@lo:101: Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.229468:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788592672.229505:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218764b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592672.229522:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939456:0@lo:101: 00010000:00010000:2.0:1788592672.229540:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.229549:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.229627:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939584:0@lo:501: 00000100:00100000:2.0:1788592672.229649:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592672.229663:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218764b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592672.230818:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939584 00000100:00100000:1.0:1788592672.230827:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939584 00000100:00100000:1.0:1788592672.230867:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788592672.230875:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939584:12345-0@lo:501: 00000100:00100000:1.0:1788592672.230986:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939584:12345-0@lo:501: Request processed in 112us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.231021:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788592672.231062:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939584:0@lo:501: 00000100:00100000:1.0:1788592672.231117:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939712:0@lo:503: 00000100:00100000:1.0:1788592672.231152:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.231173:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592672.231354:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939712 00000100:00100000:3.0:1788592672.231359:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939712 00000100:00100000:3.0:1788592672.231381:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592672.231386:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939712:12345-0@lo:503: 00000100:00100000:3.0:1788592672.231463:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939712:12345-0@lo:503: Request processed in 76us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.231470:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788592672.231646:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939712:0@lo:503: 00000040:00080000:1.0:1788592672.231829:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788592672.231883:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939840:0@lo:502: 00000100:00100000:1.0:1788592672.231915:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.231935:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592672.231972:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939840 00000100:00100000:3.0:1788592672.231976:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939840 00000100:00100000:3.0:1788592672.232008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788592672.232014:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939840:12345-0@lo:502: 00000100:00100000:3.0:1788592672.232122:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939840:12345-0@lo:502: Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.232129:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788592672.232297:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939840:0@lo:502: 00000040:00080000:0.0:1788592672.232457:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788592672.232481:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788592672.232501:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939968:0@lo:502: 00000100:00100000:0.0:1788592672.232537:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592672.232558:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742847a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592672.232615:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225939968 00000100:00100000:1.0:1788592672.232619:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225939968 00000100:00100000:1.0:1788592672.232639:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788592672.232644:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939968:12345-0@lo:502: 00000100:00100000:1.0:1788592672.232713:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225939968:12345-0@lo:502: Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.232718:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788592672.232785:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225939968:0@lo:502: 00000040:00080000:0.0:1788592672.232821:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788592672.232828:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788592672.233355:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592672.233365:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592672.233367:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592672.233373:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92174243f000 00000020:00000080:0.0:1788592672.233375:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592672.233385:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592672.233388:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592672.233389:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788592672.233392:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788592672.233560:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788592672.233583:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592672.233600:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.233611:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592672.233652:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788592672.233660:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92174243f000 10000000:01000000:1.0:1788592672.233663:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92174243f000 10000000:01000000:1.0:1788592672.233667:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592672.233672:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92174243f000 from 1 10000000:01000000:1.0:1788592672.233675:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788592672.233700:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.233708:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.233717:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.233732:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940096:0@lo:101: 00000100:00100000:1.0:1788592672.233768:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.233792:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592672.233834:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940096 00000100:00100000:0.0:1788592672.233839:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940096 00000100:00100000:0.0:1788592672.233875:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788592672.233883:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:9503:x1875475225940096:12345-0@lo:101: 00010000:00010000:0.0:1788592672.233891:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592672.233903:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4bd3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.233921:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.233938:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.233946:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840031600, rc 0) 00000100:00100000:0.0:1788592672.233975:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940096:12345-0@lo:101: Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.233981:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788592672.234280:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940096:0@lo:101: 00010000:00010000:1.0:1788592672.234293:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.234302:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.234376:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940224:0@lo:501: 00000100:00100000:1.0:1788592672.234402:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.234425:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592672.234473:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940224 00000100:00100000:0.0:1788592672.234477:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940224 00000100:00100000:0.0:1788592672.234508:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788592672.234515:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940224:12345-0@lo:501: 00000100:00100000:0.0:1788592672.234602:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940224:12345-0@lo:501: Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.234609:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788592672.234681:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940224:0@lo:501: 00000100:00100000:3.0:1788592672.234709:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940352:0@lo:503: 00000100:00100000:3.0:1788592672.234746:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.234768:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184761c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592672.234807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940352 00000100:00100000:0.0:1788592672.234811:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940352 00000100:00100000:0.0:1788592672.234832:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788592672.234837:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940352:12345-0@lo:503: 00000100:00100000:0.0:1788592672.234913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940352:12345-0@lo:503: Request processed in 74us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.234919:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788592672.234989:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940352:0@lo:503: 00000040:00080000:3.0:1788592672.235352:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592672.235406:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940480:0@lo:502: 00000100:00100000:3.0:1788592672.235450:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.235465:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184761c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592672.235520:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940480 00000100:00100000:0.0:1788592672.235525:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940480 00000100:00100000:0.0:1788592672.235549:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788592672.235555:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940480:12345-0@lo:502: 00000100:00100000:0.0:1788592672.235633:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940480:12345-0@lo:502: Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.235646:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788592672.235752:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940480:0@lo:502: 00000040:00080000:3.0:1788592672.235938:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788592672.235962:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788592672.235977:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788592672.235990:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788592672.236111:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788592672.236129:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788592672.236142:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788592672.236155:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788592672.236167:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788592672.236279:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788592672.236298:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788592672.236312:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788592672.236325:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788592672.236338:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788592672.236362:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788592672.236376:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788592672.236388:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788592672.236400:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788592672.236414:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788592672.236427:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788592672.236464:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788592672.236479:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788592672.236492:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788592672.236506:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788592672.236518:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788592672.236530:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788592672.236548:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788592672.236567:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788592672.236581:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788592672.236594:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788592672.236605:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788592672.236616:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788592672.236626:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788592672.236636:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788592672.236647:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788592672.236658:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788592672.236682:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788592672.236698:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788592672.236710:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788592672.236724:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788592672.236736:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788592672.236749:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788592672.236761:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788592672.236775:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788592672.236789:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788592672.236804:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788592672.236834:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940608:0@lo:502: 00000100:00100000:3.0:1788592672.236888:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592672.236919:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184761c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592672.237030:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940608 00000100:00100000:0.0:1788592672.237035:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940608 00000100:00100000:0.0:1788592672.237095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788592672.237103:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940608:12345-0@lo:502: 00000100:00100000:0.0:1788592672.237352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225940608:12345-0@lo:502: Request processed in 248us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.237359:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788592672.237804:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225940608:0@lo:502: 00000040:00080000:3.0:1788592672.237859:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788592672.237868:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788592672.238804:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788592672.238829:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9217435099c0) 00000020:00000080:2.0:1788592672.238854:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788592672.238938:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92174243f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788592672.238943:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92174243f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788592672.238946:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92174243f000 3 00010000:00080000:2.0:1788592672.238975:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921742497800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592672.240910:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788592672.247115:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788592672.247252:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592672.247266:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbd314a3362db4be8 00000100:00080000:2.0:1788592672.247279:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592672.247286:0:9519:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff921742497800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592672.247322:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186b9f3100 x1875475225940736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592672.247350:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788592672.247563:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475225940736:0@lo:38: 00000100:00100000:0.0:1788592672.247638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592672.247697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940736 00000100:00100000:0.0:1788592672.247703:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940736 00000100:00100000:1.0:1788592672.247730:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225940992:0@lo:400: 00000100:00100000:0.0:1788592672.247737:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592672.247744:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475225940736:12345-0@lo:38: 00010000:00080000:0.0:1788592672.247767:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000100:00100000:1.0:1788592672.247773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788592672.247800:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbd314a3362db4bef 00000100:00100000:1.0:1788592672.247808:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475225941504:0@lo:400: 00000004:00100000:0.0:1788592672.247815:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788592672.247836:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592672.247847:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9217434f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592672.247860:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788592672.247868:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475225940864:0@lo:400: 00000100:00100000:0.0:1788592672.247903:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875475225940736:12345-0@lo:38: Request processed in 156us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.247912:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592672.247917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592672.247931:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941504 00000100:00100000:0.0:1788592672.247936:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941504 00000100:00100000:1.0:1788592672.247940:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475225941376:0@lo:400: 00000100:00100000:0.0:1788592672.247956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940864 00000100:00100000:0.0:1788592672.247961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940864 00000100:00100000:1.0:1788592672.247966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.247990:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225941120:0@lo:400: 00000100:00100000:0.0:1788592672.247991:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941376 00000100:00100000:0.0:1788592672.247997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941376 00000100:00100000:0.0:1788592672.248024:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788592672.248029:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475225941504:12345-0@lo:400: 00000100:00100000:0.0:1788592672.248092:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475225941504:12345-0@lo:400: Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.248100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788592672.248117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592672.248123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475225940864:12345-0@lo:400: 00000100:00100000:0.0:1788592672.248151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475225940864:12345-0@lo:400: Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.248157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592672.248170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592672.248176:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475225941376:12345-0@lo:400: 00000100:00100000:0.0:1788592672.248202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475225941376:12345-0@lo:400: Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.248207:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788592672.248240:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f3100 x1875475225940736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592672.248247:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592672.248255:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788592672.248263:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788592672.248268:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788592672.248270:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788592672.248277:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475225940736:0@lo:38: 00000020:01000004:2.0:1788592672.248600:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788592672.248614:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff92174350cd40) 00000020:00000080:2.0:1788592672.248631:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:0.0:1788592672.248667:0:9521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1875475225941888:0@lo:901: 00000100:00100000:0.0:1788592672.248702:0:9521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788592672.248720:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92174243f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788592672.248726:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92174243f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788592672.248729:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92174243f000 3 00000100:00100000:0.0:1788592672.248734:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941888 00000100:00100000:0.0:1788592672.248739:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941888 00000100:00080000:2.0:1788592672.248764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788592672.248774:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92186ba51000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.147@tcp at head 00000100:00100000:0.0:1788592672.248784:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592672.248792:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1875475225941888:12345-0@lo:901: 00000100:00100000:0.0:1788592672.248861:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1875475225941888:12345-0@lo:901: Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.248867:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592672.248886:0:9521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217428476c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788592672.248904:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921876654380 x1875475225941888/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788592688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592672.248913:0:9521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1875475225941888:0@lo:901: 00000100:00100000:1.0:1788592672.249288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.249318:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225941632:0@lo:400: 00000100:00100000:1.0:1788592672.249339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.249359:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788592672.249367:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225941248:0@lo:400: 00000100:00100000:0.0:1788592672.249375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225940992 00000100:00100000:0.0:1788592672.249381:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225940992 00000100:00100000:1.0:1788592672.249392:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.249414:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225941760:0@lo:400: 00000100:00100000:0.0:1788592672.249417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941120 00000100:00100000:0.0:1788592672.249422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941120 00000100:00100000:0.0:1788592672.249452:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788592672.249458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225940992:12345-0@lo:400: 00000100:00100000:0.0:1788592672.249493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225940992:12345-0@lo:400: Request processed in 35us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.249499:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592672.249513:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592672.249530:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225941120:12345-0@lo:400: 00000100:00100000:3.0:1788592672.249568:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225941120:12345-0@lo:400: Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.249574:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788592672.250103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.250131:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225941120:0@lo:400: 00000100:00100000:1.0:1788592672.250160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941248 00000100:00100000:1.0:1788592672.250164:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941248 00000100:00100000:1.0:1788592672.250721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592672.250731:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225941248:12345-0@lo:400: 00000100:00100000:1.0:1788592672.250775:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225941248:12345-0@lo:400: Request processed in 48us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.250782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592672.250806:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941632 00010000:00080000:0.0:1788592672.250809:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8c000 x1875475225941248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592672.250811:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941632 00000100:00100000:0.0:1788592672.250825:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225941248:0@lo:400: 00000100:00100000:1.0:1788592672.250848:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225941760 00000100:00100000:1.0:1788592672.250853:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225941760 00000100:00100000:1.0:1788592672.250870:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592672.250876:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225941632:12345-0@lo:400: 00000100:00100000:1.0:1788592672.250912:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225941632:12345-0@lo:400: Request processed in 36us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.250918:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592672.250928:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592672.250933:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225941760:12345-0@lo:400: 00000100:00100000:1.0:1788592672.250954:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225941760:12345-0@lo:400: Request processed in 22us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.250959:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788592672.251051:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8f800 x1875475225941760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592672.251061:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225941760:0@lo:400: 00010000:00080000:0.0:1788592672.251426:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8df80 x1875475225941632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592672.251448:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225941632:0@lo:400: 00010000:00080000:1.0:1788592672.251527:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8c700 x1875475225940864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592672.251541:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475225940864:0@lo:400: 00010000:00080000:1.0:1788592672.251556:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8dc00 x1875475225941376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592672.251565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475225941376:0@lo:400: 00000100:00100000:1.0:1788592672.251575:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225940992:0@lo:400: 00010000:00080000:1.0:1788592672.251585:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921875b8ca80 x1875475225941504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592672.251592:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475225941504:0@lo:400: 00010000:00010000:2.0:1788592672.253314:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788592672.253537:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788592672.253580:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592672.253593:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbd314a3362db4bfd 00000100:00080000:2.0:1788592672.253601:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592672.253607:0:9519:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff92186ba51000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592672.253636:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186b9f1180 x1875475225942016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592672.253662:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788592672.253832:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1875475225942016:0@lo:38: 00000100:00100000:0.0:1788592672.253894:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592672.253983:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942016 00000100:00100000:2.0:1788592672.253989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942016 00000100:00100000:2.0:1788592672.254030:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592672.254036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475225942016:12345-0@lo:38: 00010000:00080000:2.0:1788592672.254057:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1788592672.254310:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbd314a3362db4c04 00000004:00100000:2.0:1788592672.254325:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592672.254355:0:6512:0:(import.c:65:import_set_state_nolock()) ffff92186f49c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592672.254512:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875475225942016:12345-0@lo:38: Request processed in 474us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.254521:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788592672.256597:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f1180 x1875475225942016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592672.256611:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788592672.256622:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788592672.256629:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788592672.256634:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788592672.256637:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92186ba51000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788592672.256644:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1875475225942016:0@lo:38: 00000040:00080000:2.0:1788592672.258267:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788592672.258641:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788592672.258674:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592672.258705:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.258717:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788592672.258763:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788592672.258766:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592672.258767:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592672.258768:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592672.258770:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592672.258771:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592672.258772:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592672.258774:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592672.258775:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592672.258776:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592672.258778:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592672.258781:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788592672.258784:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592672.258785:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592672.258786:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592672.258788:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592672.258789:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592672.258790:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592672.258791:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592672.258792:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592672.258793:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592672.258794:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592672.258795:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592672.258820:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788592672.258837:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225942144:0@lo:253: 00000100:00100000:2.0:1788592672.258901:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592672.258932:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218764b0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592672.258988:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942144 00000100:00100000:1.0:1788592672.258995:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942144 00000100:00100000:1.0:1788592672.259052:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788592672.259090:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225942144:12345-0@lo:253: 20000000:01000000:1.0:1788592672.259114:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788592672.259127:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788592672.266670:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788592672.266690:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788592672.266963:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:9503:x1875475225942144:12345-0@lo:253: Request processed in 7893us (8058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.266974:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788592672.267101:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:9503:1875475225942144:0@lo:253: 10000000:01000000:0.0:1788592672.267116:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788592672.267119:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592672.267121:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592672.267122:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592672.267123:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592672.267124:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592672.267125:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592672.267126:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592672.267127:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592672.267128:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592672.267130:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592672.267132:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788592672.267147:0:9503:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788592672.268378:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788592672.268385:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788592672.268406:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.268596:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4afa expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.268604:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.268612:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.268649:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.268663:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.268677:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225942272:0@lo:104: 00000100:00100000:2.0:1788592672.268729:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592672.268811:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4afa expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592672.268819:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4afa expref: 16 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592672.268828:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225942400:0@lo:104: 00000100:00100000:2.0:1788592672.268849:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788592672.272150:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00000100:00100000:2.0:1788592672.272439:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218764b0600 going to sleep for 11 seconds 00080000:10000000:0.0:1788592672.272595:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788592672.272792:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788592672.272961:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788592672.273368:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788592672.273713:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788592672.274014:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942400 00000100:00100000:1.0:1788592672.274023:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942400 00000100:00100000:1.0:1788592672.274096:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592672.274106:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225942400:12345-0@lo:104: 00010000:00010000:1.0:1788592672.274123:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274214:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592672.274220:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225942400:12345-0@lo:104: Request processed in 117us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.274227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788592672.274247:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592672.274253:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274262:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592672.274266:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274275:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592672.274283:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592672.274290:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592672.274332:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274339:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592672.274356:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274363:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b01 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274376:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.274378:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.274380:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592672.274392:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225942528:0@lo:103: 00000100:00100000:1.0:1788592672.274441:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.274486:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942528 00000100:00100000:1.0:1788592672.274490:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942528 00010000:00010000:1.0:1788592672.274509:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4afa expref: 17 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.274530:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592672.274537:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:3641:x1875475225942528:12345-0@lo:103: 00010000:00010000:1.0:1788592672.274547:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.274552:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4afa expref: 17 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274562:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4afa expref: 17 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.274577:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.274611:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:3641:x1875475225942528:12345-0@lo:103: Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.274617:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592672.274658:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225942528:0@lo:103: 00010000:00010000:0.0:1788592672.274961:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9218821ca200/0xbd314a3362db4b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4afa expref: 16 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592672.274973:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225942400:0@lo:104: 00000001:00000004:0.0:1788592672.275762:0:9503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788592672.279454:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942272 00000100:00100000:3.0:1788592672.279469:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942272 00000100:00100000:0.0:1788592672.282416:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592672.282439:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225942272:12345-0@lo:104: 00010000:00010000:0.0:1788592672.282457:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592672.282562:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1875475225942272:0@lo:104: 00010000:00010000:0.0:1788592672.282587:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592672.282611:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592672.282617:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:6528:x1875475225942272:12345-0@lo:104: Request processed in 190us (13888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.282623:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788592672.282738:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592672.282745:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.282752:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592672.282756:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.282765:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592672.282772:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592672.282778:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592672.282818:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.282825:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592672.282843:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.282850:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b521000/0xbd314a3362db4b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4b47 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.282866:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.282878:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592672.282880:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592672.282888:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592672.282900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225942656:0@lo:103: 00000100:00100000:1.0:1788592672.282937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.282981:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942656 00000100:00100000:1.0:1788592672.282986:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942656 00010000:00010000:1.0:1788592672.283016:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.283039:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592672.283046:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3641:x1875475225942656:12345-0@lo:103: 00010000:00010000:1.0:1788592672.283057:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592672.283062:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283102:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283116:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b521c00/0xbd314a3362db4b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4b40 expref: 16 pid: 6507 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283128:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283136:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788592672.283151:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014765772s 00010000:00010000:1.0:1788592672.283156:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283173:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283181:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283188:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283193:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592672.283197:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283203:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283218:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283227:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592672.283254:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3641:x1875475225942656:12345-0@lo:103: Request processed in 210us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.283261:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788592672.283279:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283287:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592672.283293:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80200/0xbd314a3362db4c0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592672.283330:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225942656:0@lo:103: 00002000:00080000:2.0:1788592672.284735:0:9503:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788592672.284743:0:9503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788592672.284778:0:9503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788592672.284828:0:9503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788592672.284850:0:9503:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788592672.284878:0:9503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788592672.285682:0:9503:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788592672.285883:0:9503:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788592672.697724:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788592673.095416:0:9576:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592673.095665:0:9576:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788592673.593595:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225942784:0@lo:41: 00000100:00100000:0.0:1788592673.593677:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592673.593830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942784 00000100:00100000:3.0:1788592673.593839:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942784 00000100:00100000:3.0:1788592673.593915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592673.593925:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225942784:12345-0@lo:41: 00000004:00000024:3.0:1788592673.593954:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788592673.594015:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225942784:12345-0@lo:41: Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592673.594022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592673.594089:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225942784:0@lo:41: 00000100:00100000:0.0:1788592673.594434:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592673.594444:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225942912:0@lo:41: 00000100:00100000:0.0:1788592673.594470:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592673.594555:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225942912 00000100:00100000:2.0:1788592673.594561:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225942912 00000100:00100000:2.0:1788592673.594597:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788592673.594605:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225942912:12345-0@lo:41: 00000004:00000024:2.0:1788592673.594635:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788592673.594681:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225942912:12345-0@lo:41: Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592673.594688:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788592673.594794:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225942912:0@lo:41: 00010000:00010000:3.0:1788592673.720250:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592674.744396:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592675.772253:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592676.664213:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225943168:0@lo:13: 00000100:00100000:0.0:1788592676.664281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592676.664332:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943168 00000100:00100000:3.0:1788592676.664340:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943168 00000100:00100000:0.0:1788592676.664345:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225943040:0@lo:13: 00000100:00100000:0.0:1788592676.664367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592676.664384:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943040 00000100:00100000:3.0:1788592676.664387:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943040 00000100:00100000:0.0:1788592676.664408:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592676.664790:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225943168:12345-0@lo:13: 00002000:00000024:0.0:1788592676.664826:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592676.664880:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225943168:12345-0@lo:13: Request processed in 464us (600us total) trans 0 rc 0/0 00010000:00080000:1.0:1788592676.664941:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921876656680 x1875475225943168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592676.664960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225943168:0@lo:13: 00000100:00080000:3.0:1788592676.666159:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592676.666327:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592676.666357:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592676.666370:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225943040:12345-0@lo:13: 00002000:00000024:0.0:1788592676.666389:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592676.666472:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225943040:12345-0@lo:13: Request processed in 108us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592676.666479:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788592676.666573:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875abb100 x1875475225943040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592676.666590:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225943040:0@lo:13: 00010000:00010000:1.0:1788592676.801370:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788592677.392308:0:9865:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788592677.688386:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225943424:0@lo:400: 00000100:00100000:3.0:1788592677.688466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.688514:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225943936:0@lo:400: 00000100:00100000:3.0:1788592677.688536:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.688560:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225944448:0@lo:400: 00000100:00100000:3.0:1788592677.688584:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.688606:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788592677.688612:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225943552:0@lo:400: 00000100:00100000:3.0:1788592677.688635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.688657:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225944064:0@lo:400: 00000100:00100000:3.0:1788592677.688693:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.688706:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225944576:0@lo:400: 00000100:00100000:3.0:1788592677.688724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.688755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943424 00000100:00100000:3.0:1788592677.688762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943424 00000100:00100000:3.0:1788592677.688795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943936 00000100:00100000:3.0:1788592677.688798:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943936 00000100:00100000:3.0:1788592677.688818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944448 00000100:00100000:3.0:1788592677.688821:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944448 00000100:00100000:3.0:1788592677.688832:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944064 00000100:00100000:3.0:1788592677.688834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944064 00000100:00100000:3.0:1788592677.688847:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944576 00000100:00100000:3.0:1788592677.688850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944576 00000100:00100000:3.0:1788592677.688865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788592677.688872:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225943424:12345-0@lo:400: 00000100:00100000:3.0:1788592677.688919:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225943424:12345-0@lo:400: Request processed in 47us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.688926:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788592677.688942:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592677.688948:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225943936:12345-0@lo:400: 00000100:00100000:3.0:1788592677.688973:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225943936:12345-0@lo:400: Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.688977:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592677.688988:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592677.688993:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225944448:12345-0@lo:400: 00000100:00100000:3.0:1788592677.689018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225944448:12345-0@lo:400: Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.689023:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592677.689043:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788592677.689050:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225944064:12345-0@lo:400: 00000100:00100000:3.0:1788592677.689104:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225944064:12345-0@lo:400: Request processed in 56us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.689111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788592677.689122:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788592677.689127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225944576:12345-0@lo:400: 00000100:00100000:3.0:1788592677.689148:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225944576:12345-0@lo:400: Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.689153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788592677.689174:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943552 00000100:00100000:3.0:1788592677.689177:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943552 00000100:00100000:3.0:1788592677.689197:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592677.689202:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225943552:12345-0@lo:400: 00000100:00100000:3.0:1788592677.689227:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225943552:12345-0@lo:400: Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.689232:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788592677.689366:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225943680:0@lo:400: 00000100:00100000:0.0:1788592677.689408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592677.689428:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225944192:0@lo:400: 00000100:00100000:0.0:1788592677.689448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592677.689465:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592677.689470:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225943296:0@lo:400: 00000100:00100000:0.0:1788592677.689491:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592677.689508:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475225943808:0@lo:400: 00000100:00100000:0.0:1788592677.689525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788592677.689838:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592677.689842:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592677.692646:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943680 00000100:00100000:0.0:1788592677.692658:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943680 00000100:00100000:0.0:1788592677.692754:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788592677.692764:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225943680:12345-0@lo:400: 00000100:00100000:0.0:1788592677.692835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225943680:12345-0@lo:400: Request processed in 74us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592677.692843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788592677.693145:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225943552:0@lo:400: 00010000:00080000:2.0:1788592677.693161:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875ab8000 x1875475225944064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.693171:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225944064:0@lo:400: 00010000:00080000:2.0:1788592677.693186:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741dd8380 x1875475225944576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.693194:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225944576:0@lo:400: 00010000:00080000:2.0:1788592677.693205:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875abb480 x1875475225943424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.693212:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225943424:0@lo:400: 00010000:00080000:2.0:1788592677.693222:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875ab8e00 x1875475225943936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.693228:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225943936:0@lo:400: 00010000:00080000:2.0:1788592677.693251:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741ddb480 x1875475225944448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.693258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225944448:0@lo:400: 00000100:00100000:0.0:1788592677.693848:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944192 00000100:00100000:0.0:1788592677.693855:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944192 00000100:00100000:0.0:1788592677.693893:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592677.693900:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225944192:12345-0@lo:400: 00000100:00100000:0.0:1788592677.693946:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225944192:12345-0@lo:400: Request processed in 48us (4497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592677.693953:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592677.693978:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943296 00000100:00100000:0.0:1788592677.693982:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943296 00000100:00100000:0.0:1788592677.694004:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788592677.694010:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3641:x1875475225943296:12345-0@lo:400: 00000100:00100000:0.0:1788592677.694036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3641:x1875475225943296:12345-0@lo:400: Request processed in 27us (4545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592677.694042:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788592677.694105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225944320:0@lo:400: 00000100:00100000:0.0:1788592677.694135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592677.694155:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944320 00000100:00100000:0.0:1788592677.694159:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944320 00000100:00100000:0.0:1788592677.694181:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592677.694186:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225944320:12345-0@lo:400: 00000100:00100000:0.0:1788592677.694213:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225944320:12345-0@lo:400: Request processed in 26us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592677.694218:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788592677.694244:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741ddaa00 x1875475225944320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592677.694253:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225944320:0@lo:400: 00000100:00100000:0.0:1788592677.694264:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225943680:0@lo:400: 00010000:00080000:0.0:1788592677.694283:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741dda300 x1875475225944192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592677.694291:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225944192:0@lo:400: 00000100:00100000:0.0:1788592677.694309:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225943296:0@lo:400: 00000100:00100000:2.0:1788592677.695156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225943808 00000100:00100000:2.0:1788592677.695164:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225943808 00000100:00100000:2.0:1788592677.695199:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592677.695207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475225943808:12345-0@lo:400: 00000100:00100000:2.0:1788592677.695255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475225943808:12345-0@lo:400: Request processed in 49us (5729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.695261:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788592677.695423:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875ab9c00 x1875475225943808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592677.695434:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475225943808:0@lo:400: 00010000:00010000:3.0:1788592677.822512:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788592678.249954:0:9917:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788592678.250288:0:9917:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788592678.713624:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592678.713648:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225944704:0@lo:41: 00000100:00100000:1.0:1788592678.713723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592678.713763:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944704 00000100:00100000:1.0:1788592678.713769:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944704 00000100:00100000:1.0:1788592678.713809:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788592678.713818:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225944704:12345-0@lo:41: 00000004:00000024:1.0:1788592678.714007:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788592678.714053:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225944704:12345-0@lo:41: Request processed in 235us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592678.714060:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788592678.714192:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225944704:0@lo:41: 00000100:00100000:2.0:1788592678.716349:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592678.716370:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225944832:0@lo:41: 00000100:00100000:2.0:1788592678.716436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592678.717049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944832 00000100:00100000:3.0:1788592678.717058:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944832 00000100:00100000:3.0:1788592678.717153:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592678.717162:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225944832:12345-0@lo:41: 00000004:00000024:3.0:1788592678.717193:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788592678.717247:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225944832:12345-0@lo:41: Request processed in 86us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592678.717253:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592678.717419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225944832:0@lo:41: 00010000:00010000:0.0:1788592678.841599:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592679.873196:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788592680.761810:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788592680.761817:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9218764b9000 from 39 10000000:01000000:0.0:1788592680.761822:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592680.761862:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.761873:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.761883:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592680.761905:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225944960:0@lo:101: 00000100:00100000:0.0:1788592680.762474:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.762572:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.764469:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225944960 00000100:00100000:3.0:1788592680.764482:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225944960 00000100:00100000:3.0:1788592680.764533:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788592680.764543:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225944960:12345-0@lo:101: 00010000:00010000:3.0:1788592680.764558:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592680.764817:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c12 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.764846:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.764858:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.764867:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f200, rc 0) 00000100:00100000:3.0:1788592680.765196:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225944960:12345-0@lo:101: Request processed in 653us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.765204:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788592680.765276:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225944960:0@lo:101: 00010000:00010000:2.0:1788592680.765294:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.765305:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.765389:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945088:0@lo:501: 00000100:00100000:2.0:1788592680.765423:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.765488:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.765538:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945088 00000100:00100000:3.0:1788592680.765543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945088 00000100:00100000:3.0:1788592680.765890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788592680.765900:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225945088:12345-0@lo:501: 00000100:00100000:3.0:1788592680.766337:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225945088:12345-0@lo:501: Request processed in 438us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.766345:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788592680.766411:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945088:0@lo:501: 00000100:00100000:2.0:1788592680.766447:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945216:0@lo:503: 00000100:00100000:2.0:1788592680.766487:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.766546:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.766778:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945216 00000100:00100000:3.0:1788592680.766783:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945216 00000100:00100000:3.0:1788592680.766851:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788592680.766859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225945216:12345-0@lo:503: 00000100:00100000:3.0:1788592680.766968:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225945216:12345-0@lo:503: Request processed in 111us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.766975:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788592680.767065:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945216:0@lo:503: 00000100:00100000:0.0:1788592680.768513:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10017:1875475225945344:0@lo:502: 00000100:00100000:0.0:1788592680.771629:0:10017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592680.772693:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945344 00000100:00100000:3.0:1788592680.772703:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945344 00000100:00100000:3.0:1788592680.772761:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788592680.772771:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10017:x1875475225945344:12345-0@lo:502: 00000100:00100000:1.0:1788592680.773135:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.774527:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10017:x1875475225945344:12345-0@lo:502: Request processed in 1753us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.774540:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788592680.775725:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10017:1875475225945344:0@lo:502: 00000100:00100000:2.0:1788592680.775796:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10017:1875475225945472:0@lo:502: 00000100:00100000:2.0:1788592680.776277:0:10017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.776350:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b2079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.776392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945472 00000100:00100000:3.0:1788592680.776399:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945472 00000100:00100000:3.0:1788592680.776475:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788592680.776485:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10017:x1875475225945472:12345-0@lo:502: 00000100:00100000:3.0:1788592680.776603:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10017:x1875475225945472:12345-0@lo:502: Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.776610:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788592680.776694:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10017:1875475225945472:0@lo:502: 00000040:00080000:0.0:1788592680.776717:0:10017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788592680.777174:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788592680.777199:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592680.777210:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.777221:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592680.777231:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788592680.777233:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788592680.777236:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788592680.777264:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.777272:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.777281:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.777298:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945600:0@lo:101: 00000100:00100000:2.0:1788592680.777342:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.777363:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.777475:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945600 00000100:00100000:3.0:1788592680.777481:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945600 00000100:00100000:3.0:1788592680.777550:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788592680.777559:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225945600:12345-0@lo:101: 00010000:00010000:3.0:1788592680.777568:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592680.777579:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c20 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.777601:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.777621:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.777629:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ec00, rc 0) 00000100:00100000:3.0:1788592680.777675:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225945600:12345-0@lo:101: Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.777681:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788592680.777735:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945600:0@lo:101: 00010000:00010000:1.0:1788592680.777748:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.777763:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592680.777811:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945728:0@lo:501: 00000100:00100000:1.0:1788592680.777837:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.777916:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781540 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.778028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945728 00000100:00100000:2.0:1788592680.778033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945728 00000100:00100000:2.0:1788592680.778055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788592680.778061:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225945728:12345-0@lo:501: 00000100:00100000:2.0:1788592680.778191:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225945728:12345-0@lo:501: Request processed in 129us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.778198:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788592680.778288:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945728:0@lo:501: 00000100:00100000:1.0:1788592680.778313:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945856:0@lo:503: 00000100:00100000:1.0:1788592680.778344:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.778356:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781540 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.779432:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945856 00000100:00100000:2.0:1788592680.779439:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945856 00000100:00100000:2.0:1788592680.779462:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788592680.779466:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225945856:12345-0@lo:503: 00000100:00100000:2.0:1788592680.779557:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225945856:12345-0@lo:503: Request processed in 89us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.779564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788592680.779642:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225945856:0@lo:503: 00000100:00100000:3.0:1788592680.780774:0:10021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10021:1875475225945984:0@lo:502: 00000100:00100000:3.0:1788592680.780897:0:10021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.781010:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225945984 00000100:00100000:2.0:1788592680.781015:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225945984 00000100:00100000:3.0:1788592680.781121:0:10021:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.781235:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788592680.781244:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10021:x1875475225945984:12345-0@lo:502: 00000100:00100000:2.0:1788592680.781340:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10021:x1875475225945984:12345-0@lo:502: Request processed in 97us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.781347:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788592680.781433:0:10021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10021:1875475225945984:0@lo:502: 00000020:01000000:3.0:1788592680.781464:0:10021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592680.781473:0:10021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592680.781475:0:10021:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592680.781480:0:10021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592680.781482:0:10021:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788592680.781499:0:10021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10021:1875475225946112:0@lo:502: 00000100:00100000:3.0:1788592680.781529:0:10021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.781910:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946112 00000100:00100000:0.0:1788592680.781922:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946112 00000100:00100000:0.0:1788592680.781947:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788592680.781954:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10021:x1875475225946112:12345-0@lo:502: 00000100:00100000:0.0:1788592680.782037:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10021:x1875475225946112:12345-0@lo:502: Request processed in 84us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.782045:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788592680.782352:0:10021:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.782368:0:10021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10021:1875475225946112:0@lo:502: 00000020:01000000:3.0:1788592680.782403:0:10021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592680.782407:0:10021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592680.782409:0:10021:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788592680.782413:0:10021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788592680.782568:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788592680.782589:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788592680.782598:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.782609:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592680.782619:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788592680.782621:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921875948800 from 39 10000000:01000000:0.0:1788592680.782624:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592680.782763:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.782772:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.782781:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592680.782805:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946240:0@lo:101: 00000100:00100000:0.0:1788592680.782904:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.784596:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.786907:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946240 00000100:00100000:3.0:1788592680.787207:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946240 00000100:00100000:3.0:1788592680.787316:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788592680.787348:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225946240:12345-0@lo:101: 00010000:00010000:3.0:1788592680.787364:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592680.787390:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c2e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.787414:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.787424:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592680.787433:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e800, rc 0) 00000100:00100000:3.0:1788592680.787508:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225946240:12345-0@lo:101: Request processed in 162us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.787514:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788592680.787591:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946240:0@lo:101: 00010000:00010000:0.0:1788592680.787609:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.787617:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1788592680.787694:0:10020:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:0.0:1788592680.787695:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946368:0@lo:501: 00000100:00100000:0.0:1788592680.787727:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.787947:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd900 going to sleep for 11 seconds 00000020:00000004:1.0:1788592680.787960:0:10020:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788592680.788290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946368 00000100:00100000:2.0:1788592680.788296:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946368 00000100:00100000:2.0:1788592680.788323:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788592680.788342:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225946368:12345-0@lo:501: 00000100:00100000:2.0:1788592680.788488:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225946368:12345-0@lo:501: Request processed in 147us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.788495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788592680.788628:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946368:0@lo:501: 00000100:00100000:1.0:1788592680.788663:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946496:0@lo:503: 00000100:00100000:1.0:1788592680.788702:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.788733:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781540 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.788801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946496 00000100:00100000:3.0:1788592680.788806:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946496 00000100:00100000:3.0:1788592680.788904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788592680.788911:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225946496:12345-0@lo:503: 00000100:00100000:3.0:1788592680.788996:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225946496:12345-0@lo:503: Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.789110:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946496:0@lo:503: 00000100:00100000:3.0:1788592680.789199:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788592680.789537:0:10022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10022:1875475225946624:0@lo:502: 00000100:00100000:2.0:1788592680.789569:0:10022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.789588:0:10022:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.789736:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946624 00000100:00100000:2.0:1788592680.789741:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946624 00000100:00100000:2.0:1788592680.789764:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788592680.789771:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10022:x1875475225946624:12345-0@lo:502: 00000100:00100000:2.0:1788592680.789975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10022:x1875475225946624:12345-0@lo:502: Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.789983:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788592680.790181:0:10022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10022:1875475225946624:0@lo:502: 00000100:00100000:2.0:1788592680.790222:0:10022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10022:1875475225946752:0@lo:502: 00000100:00100000:2.0:1788592680.790251:0:10022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.790270:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946752 00000100:00100000:2.0:1788592680.790273:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946752 00000100:00100000:2.0:1788592680.790292:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788592680.790297:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10022:x1875475225946752:12345-0@lo:502: 00000100:00100000:2.0:1788592680.790424:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10022:x1875475225946752:12345-0@lo:502: Request processed in 126us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.790431:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788592680.790460:0:10022:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.790470:0:10022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10022:1875475225946752:0@lo:502: 00000040:00080000:2.0:1788592680.790492:0:10022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788592680.790545:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788592680.790564:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592680.790574:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.790584:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592680.790593:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788592680.790595:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921875948800 from 6 10000000:01000000:2.0:1788592680.790597:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592680.790622:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.790630:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.790640:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.790888:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946880:0@lo:101: 00000100:00100000:2.0:1788592680.791081:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.791123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225946880 00000100:00100000:1.0:1788592680.791128:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225946880 00000100:00100000:1.0:1788592680.791155:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788592680.791161:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225946880:12345-0@lo:101: 00010000:00010000:1.0:1788592680.791170:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592680.791182:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742838200/0xbd314a3362db4c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c3c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.791214:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742838200/0xbd314a3362db4c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c3c expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.791225:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742838200/0xbd314a3362db4c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c3c expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.791234:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838200, rc 0) 00000100:00100000:1.0:1788592680.803604:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225946880:12345-0@lo:101: Request processed in 12436us (12680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.803619:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788592680.805905:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.805999:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225946880:0@lo:101: 00010000:00010000:2.0:1788592680.806023:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.806035:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.806122:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947008:0@lo:256: 00000100:00100000:2.0:1788592680.806172:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.806194:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.806288:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947008 00000100:00100000:3.0:1788592680.806296:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947008 00000100:00100000:3.0:1788592680.806352:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788592680.806368:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225947008:12345-0@lo:256: 20000000:01000000:3.0:1788592680.806403:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788592680.806420:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788592680.806427:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788592680.806547:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225947008:12345-0@lo:256: Request processed in 185us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.806558:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788592680.807188:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947008:0@lo:256: 10000000:01000000:2.0:1788592680.807235:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592680.807243:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.807252:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592680.807511:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788592680.807513:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788592680.807516:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788592680.807543:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.807551:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.807560:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.807575:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947136:0@lo:101: 00000100:00100000:2.0:1788592680.807616:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.807642:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.809848:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947136 00000100:00100000:1.0:1788592680.809862:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947136 00000100:00100000:1.0:1788592680.810143:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788592680.810153:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225947136:12345-0@lo:101: 00010000:00010000:1.0:1788592680.810170:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592680.810188:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.810211:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.810221:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.810229:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838400, rc 0) 00000100:00100000:1.0:1788592680.810290:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225947136:12345-0@lo:101: Request processed in 139us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.810297:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788592680.810468:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947136:0@lo:101: 00010000:00010000:2.0:1788592680.810495:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.810504:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.810572:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947264:0@lo:501: 00000100:00100000:2.0:1788592680.810608:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.810650:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.810769:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947264 00000100:00100000:1.0:1788592680.810774:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947264 00000100:00100000:1.0:1788592680.810803:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788592680.810810:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225947264:12345-0@lo:501: 00000100:00100000:1.0:1788592680.811724:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225947264:12345-0@lo:501: Request processed in 910us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.811732:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788592680.812435:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947264:0@lo:501: 00000100:00100000:2.0:1788592680.812481:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947392:0@lo:503: 00000100:00100000:2.0:1788592680.812527:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.812558:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.813198:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947392 00000100:00100000:1.0:1788592680.813205:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947392 00000100:00100000:1.0:1788592680.813253:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788592680.813261:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225947392:12345-0@lo:503: 00000100:00100000:1.0:1788592680.813389:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225947392:12345-0@lo:503: Request processed in 128us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.813396:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788592680.813506:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225947392:0@lo:503: 00000100:00100000:3.0:1788592680.813836:0:10024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10024:1875475225947520:0@lo:502: 00000100:00100000:3.0:1788592680.813876:0:10024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592680.813923:0:10024:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.814059:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947520 00000100:00100000:1.0:1788592680.814091:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947520 00000100:00100000:1.0:1788592680.814122:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788592680.814129:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10024:x1875475225947520:12345-0@lo:502: 00000100:00100000:1.0:1788592680.814210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10024:x1875475225947520:12345-0@lo:502: Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.814217:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788592680.814333:0:10024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10024:1875475225947520:0@lo:502: 00000020:01000000:3.0:1788592680.814355:0:10024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788592680.814364:0:10024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788592680.814378:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592680.814380:0:10024:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788592680.814385:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788592680.814390:0:10024:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:3.0:1788592680.814412:0:10024:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788592680.814415:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592680.814427:0:10024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff921742aa0000) 00000020:00000080:3.0:1788592680.814449:0:10024:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788592680.814454:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788592680.814534:0:10024:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788592680.814540:0:10024:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788592680.814547:0:10024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db4c5f 00010000:00080000:3.0:1788592680.814572:0:10024:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92187c935000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592680.814769:0:10024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788592680.814883:0:10024:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788592680.814892:0:10024:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788592680.815626:0:10024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592680.815742:0:10024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592680.815875:0:10024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788592680.816160:0:10024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788592680.817352:0:10025:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592680.817358:0:10025:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788592680.826940:0:10024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788592680.826955:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788592680.827002:0:10024:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788592680.827029:0:10024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db4c66 00000100:00080000:2.0:1788592680.827039:0:10024:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592680.827045:0:10024:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff92187c935000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592680.827099:0:10024:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186b9f0700 x1875475225947648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592680.827123:0:10024:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788592680.827176:0:10024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592680.827180:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592680.827182:0:10024:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00100000:3.0:1788592680.827188:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475225947648:0@lo:8: 00000020:01000000:2.0:1788592680.827191:0:10024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592680.827195:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592680.827196:0:10024:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788592680.827199:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788592680.827201:0:10024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788592680.827223:0:10024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10024:1875475225947776:0@lo:502: 00000100:00100000:2.0:1788592680.827260:0:10024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592680.827270:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.827315:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947776 00000100:00100000:0.0:1788592680.827322:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947776 00000100:00100000:0.0:1788592680.827384:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788592680.827394:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10024:x1875475225947776:12345-0@lo:502: 00000100:00100000:1.0:1788592680.827625:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225947904:0@lo:400: 00000100:00100000:3.0:1788592680.827816:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225948032:0@lo:400: 00000100:00100000:3.0:1788592680.827845:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592680.827863:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475225948544:0@lo:400: 00000100:00100000:3.0:1788592680.827884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592680.827901:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475225949056:0@lo:400: 00000100:00100000:3.0:1788592680.828001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592680.828032:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948032 00000100:00100000:3.0:1788592680.828037:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948032 00000100:00100000:3.0:1788592680.828087:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592680.828095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225948032:12345-0@lo:400: 00000100:00100000:3.0:1788592680.828135:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225948032:12345-0@lo:400: Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.828142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592680.828162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948544 00000100:00100000:3.0:1788592680.828165:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948544 00000100:00100000:3.0:1788592680.828192:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949056 00000100:00100000:3.0:1788592680.828195:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949056 00000100:00100000:3.0:1788592680.828207:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592680.828211:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475225948544:12345-0@lo:400: 00000100:00100000:3.0:1788592680.828241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475225948544:12345-0@lo:400: Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.828247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592680.828271:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592680.828278:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475225949056:12345-0@lo:400: 00000100:00100000:3.0:1788592680.828315:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475225949056:12345-0@lo:400: Request processed in 38us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.828322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592680.828383:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225948032:0@lo:400: 00010000:00080000:3.0:1788592680.828396:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360e300 x1875475225948544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592680.828405:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475225948544:0@lo:400: 00010000:00080000:3.0:1788592680.828413:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b8ca80 x1875475225949056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592680.828421:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475225949056:0@lo:400: 00000100:00080000:3.0:1788592680.828445:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592680.830530:0:10024:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592680.831528:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10024:x1875475225947776:12345-0@lo:502: Request processed in 4130us (4262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.831541:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788592680.831609:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947648 00000100:00100000:0.0:1788592680.831616:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947648 00000100:00100000:0.0:1788592680.831646:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592680.831653:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475225947648:12345-0@lo:8: 00010000:00080000:0.0:1788592680.831680:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1788592680.831706:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db4c6d 00002000:00100000:0.0:1788592680.831724:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9217434f1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788592680.831727:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788592680.831731:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788592680.831782:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788592680.832050:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788592680.832096:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9217434f7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592680.832120:0:10024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10024:1875475225947776:0@lo:502: 00000100:00100000:0.0:1788592680.832152:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875475225947648:12345-0@lo:8: Request processed in 498us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.832158:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788592680.832206:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f0700 x1875475225947648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.832216:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592680.832223:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000020:01000000:2.0:1788592680.832224:0:10024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592680.832230:0:10024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1788592680.832230:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:00000080:2.0:1788592680.832232:0:10024:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000100:00080000:0.0:1788592680.832235:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000040:00080000:2.0:1788592680.832237:0:10024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00080000:0.0:1788592680.832237:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c935000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788592680.832248:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:01000000:2.0:1788592680.832297:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788592680.832324:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788592680.832333:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832343:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592680.832352:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788592680.832355:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921846c66000 from 39 10000000:01000000:2.0:1788592680.832358:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592680.832394:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832402:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832410:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.832432:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949184:0@lo:101: 00000100:00100000:2.0:1788592680.832464:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.832491:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.832509:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949184 00000100:00100000:2.0:1788592680.832513:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949184 00000100:00100000:2.0:1788592680.832541:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788592680.832549:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225949184:12345-0@lo:101: 00010000:00010000:2.0:1788592680.832558:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592680.832569:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c74 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832588:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832596:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832605:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80e00, rc 0) 00000100:00100000:2.0:1788592680.832632:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225949184:12345-0@lo:101: Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.832633:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475225947648:0@lo:8: 00000100:00100000:2.0:1788592680.832638:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788592680.832664:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949184:0@lo:101: 00010000:00010000:2.0:1788592680.832675:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.832683:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.832736:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949312:0@lo:501: 00000100:00100000:2.0:1788592680.832760:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.832786:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000004:00080000:2.0:1788592680.832799:0:10025:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788592680.832849:0:10025:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 215079781366ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788592680.832854:0:10025:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788592680.833469:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949312 00000100:00100000:0.0:1788592680.833476:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949312 00000100:00100000:0.0:1788592680.833505:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788592680.833512:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225949312:12345-0@lo:501: 00000100:00100000:0.0:1788592680.833632:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225949312:12345-0@lo:501: Request processed in 119us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.833639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788592680.833675:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949312:0@lo:501: 00000100:00100000:0.0:1788592680.833713:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949440:0@lo:503: 00000100:00100000:0.0:1788592680.833747:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.833767:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592680.833780:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949440 00000100:00100000:0.0:1788592680.833782:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949440 00000100:00100000:0.0:1788592680.833802:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788592680.833807:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225949440:12345-0@lo:503: 00000100:00100000:0.0:1788592680.833878:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225949440:12345-0@lo:503: Request processed in 70us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.833885:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788592680.833935:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949440:0@lo:503: 00000100:00100000:0.0:1788592680.834126:0:10028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10028:1875475225949568:0@lo:502: 00000100:00100000:0.0:1788592680.834160:0:10028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.834179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949568 00000100:00100000:0.0:1788592680.834182:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949568 00000100:00100000:0.0:1788592680.834204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788592680.834210:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10028:x1875475225949568:12345-0@lo:502: 00000100:00100000:1.0:1788592680.835434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835474:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225948416:0@lo:400: 00000100:00100000:1.0:1788592680.835505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835521:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225948928:0@lo:400: 00000100:00100000:1.0:1788592680.835557:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835594:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225948160:0@lo:400: 00000100:00100000:1.0:1788592680.835617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835634:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225948672:0@lo:400: 00000100:00100000:1.0:1788592680.835652:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835669:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788592680.835675:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475225948288:0@lo:400: 00000100:00100000:1.0:1788592680.835690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835699:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225948800:0@lo:400: 00000100:00100000:1.0:1788592680.835712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.835738:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225947904 00000100:00100000:1.0:1788592680.835744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225947904 00000100:00100000:1.0:1788592680.835771:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948416 00000100:00100000:1.0:1788592680.835774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948416 00000100:00100000:1.0:1788592680.835792:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948928 00000100:00100000:1.0:1788592680.835794:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948928 00000100:00100000:1.0:1788592680.835805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948288 00000100:00100000:1.0:1788592680.835807:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948288 00000100:00100000:1.0:1788592680.835821:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592680.835827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225947904:12345-0@lo:400: 00000100:00100000:1.0:1788592680.835872:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225947904:12345-0@lo:400: Request processed in 44us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.835878:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592680.835892:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788592680.835898:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225948416:12345-0@lo:400: 00000100:00100000:3.0:1788592680.836045:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592680.836054:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788592680.836085:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592680.836093:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592680.836099:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225948928:12345-0@lo:400: 00000100:00100000:0.0:1788592680.836193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10028:x1875475225949568:12345-0@lo:502: Request processed in 1982us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.836201:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788592680.836249:0:10028:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592680.836279:0:10028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10028:1875475225949568:0@lo:502: 00000100:00100000:0.0:1788592680.836653:0:10028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10028:1875475225949696:0@lo:502: 00000100:00100000:0.0:1788592680.836694:0:10028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.836721:0:10028:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.836800:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225948928:12345-0@lo:400: Request processed in 701us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.836808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592680.836823:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592680.836831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592680.836837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475225948288:12345-0@lo:400: 00000100:00100000:3.0:1788592680.836880:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475225948288:12345-0@lo:400: Request processed in 44us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.836887:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788592680.836913:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592680.837090:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949696 00000100:00100000:2.0:1788592680.837097:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949696 00000100:00100000:2.0:1788592680.837126:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788592680.837145:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10028:x1875475225949696:12345-0@lo:502: 00000100:00100000:2.0:1788592680.837277:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10028:x1875475225949696:12345-0@lo:502: Request processed in 145us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.837283:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000004:00080000:2.0:1788592680.837362:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:0.0:1788592680.837964:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360ed80 x1875475225948288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.837979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475225948288:0@lo:400: 00000100:00100000:0.0:1788592680.838009:0:10028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10028:1875475225949696:0@lo:502: 00000040:00080000:0.0:1788592680.838035:0:10028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788592680.838110:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788592680.838130:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592680.838139:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838149:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592680.838158:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788592680.838160:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff921846c66000 from 6 10000000:01000000:0.0:1788592680.838163:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788592680.838190:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838198:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838207:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592680.838221:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949824:0@lo:101: 00000100:00100000:0.0:1788592680.838272:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.838299:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592680.838315:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949824 00000100:00100000:0.0:1788592680.838325:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949824 00000100:00100000:0.0:1788592680.838494:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788592680.838500:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225949824:12345-0@lo:101: 00010000:00010000:0.0:1788592680.838509:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592680.838521:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841495200/0xbd314a3362db4c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c82 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838541:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495200/0xbd314a3362db4c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c82 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838551:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841495200/0xbd314a3362db4c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c82 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838559:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841495200, rc 0) 00000100:00100000:0.0:1788592680.838589:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225949824:12345-0@lo:101: Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.838595:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788592680.838626:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949824:0@lo:101: 00010000:00010000:0.0:1788592680.838640:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.838647:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592680.838686:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949952:0@lo:256: 00000100:00100000:0.0:1788592680.838713:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.838726:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.838860:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225949952 00000100:00100000:2.0:1788592680.838865:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225949952 00000100:00100000:2.0:1788592680.838897:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788592680.838904:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225949952:12345-0@lo:256: 00000100:00100000:0.0:1788592680.839128:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948672 00000100:00100000:0.0:1788592680.839133:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948672 00000100:00100000:0.0:1788592680.839175:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948800 00000100:00100000:0.0:1788592680.839178:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948800 00000100:00100000:0.0:1788592680.839198:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592680.839204:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225948672:12345-0@lo:400: 00000100:00100000:0.0:1788592680.839244:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225948672:12345-0@lo:400: Request processed in 41us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.839251:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592680.839275:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592680.839281:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225948800:12345-0@lo:400: 00000100:00100000:0.0:1788592680.839309:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225948800:12345-0@lo:400: Request processed in 28us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.839314:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592680.839460:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225948160 00000100:00100000:0.0:1788592680.839465:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225948160 00000100:00100000:0.0:1788592680.839489:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592680.839496:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225948160:12345-0@lo:400: 00000100:00100000:0.0:1788592680.839532:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225948160:12345-0@lo:400: Request processed in 36us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.839538:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788592680.839575:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360d180 x1875475225948800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.839585:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225948800:0@lo:400: 00000100:00100000:0.0:1788592680.839596:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225948160:0@lo:400: 00010000:00080000:0.0:1788592680.839605:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360f100 x1875475225948672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.839612:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225948672:0@lo:400: 00000100:00100000:0.0:1788592680.839684:0:10026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225950080:0@lo:700: 00000100:00100000:0.0:1788592680.839716:0:10026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.839734:0:10026:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bdb40 going to sleep for 11 seconds 00000100:00080000:3.0:1788592680.839819:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592680.839887:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225948416:12345-0@lo:400: Request processed in 3987us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.839904:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788592680.840022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360ca80 x1875475225947904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.840032:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225947904:0@lo:400: 00010000:00080000:1.0:1788592680.840044:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360c380 x1875475225948416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.840050:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225948416:0@lo:400: 00010000:00080000:1.0:1788592680.840061:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360d500 x1875475225948928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.840678:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225948928:0@lo:400: 20000000:01000000:2.0:1788592680.843081:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788592680.843104:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788592680.843108:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788592680.843241:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225949952:12345-0@lo:256: Request processed in 4335us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.843254:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788592680.843302:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950080 00000100:00100000:2.0:1788592680.843309:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950080 00000100:00100000:2.0:1788592680.843352:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592680.843363:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225949952:0@lo:256: 00000100:00100000:2.0:1788592680.843364:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10026:x1875475225950080:12345-0@lo:700: 00000100:00100000:2.0:1788592680.843416:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1875475225950208:0@lo:700: 10000000:01000000:1.0:1788592680.843424:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592680.843434:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.843445:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592680.843445:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592680.843453:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788592680.843456:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788592680.843459:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:2.0:1788592680.843467:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207000 going to sleep for 11 seconds 00000100:00080000:2.0:1788592680.843481:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788592680.843483:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.843490:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.843506:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592680.843519:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225950336:0@lo:101: 00000100:00100000:1.0:1788592680.843548:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.843580:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858657240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.843596:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950336 00000100:00100000:2.0:1788592680.843600:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950336 00000100:00100000:2.0:1788592680.843625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788592680.843631:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225950336:12345-0@lo:101: 00010000:00010000:2.0:1788592680.843639:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592680.843650:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4c90 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.843670:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.843680:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.843689:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81a00, rc 0) 00000100:00100000:2.0:1788592680.843716:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225950336:12345-0@lo:101: Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.843721:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788592680.844186:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950208 00000100:00100000:2.0:1788592680.844191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950208 00000100:00100000:2.0:1788592680.844224:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592680.844231:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1875475225950208:12345-0@lo:700: 00000100:00100000:1.0:1788592680.844387:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225950336:0@lo:101: 00010000:00010000:1.0:1788592680.844404:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592680.844413:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592680.844467:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225950464:0@lo:501: 00000100:00100000:1.0:1788592680.844499:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.844522:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858657240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.845444:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950464 00000100:00100000:2.0:1788592680.845459:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950464 00000100:00100000:2.0:1788592680.845499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788592680.845506:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225950464:12345-0@lo:501: 00000100:00100000:2.0:1788592680.845632:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225950464:12345-0@lo:501: Request processed in 126us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.845640:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788592680.845682:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225950464:0@lo:501: 00000100:00100000:2.0:1788592680.845720:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225950592:0@lo:503: 00000100:00100000:2.0:1788592680.845756:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.845772:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845433480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.845783:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950592 00000100:00100000:2.0:1788592680.845786:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950592 00000100:00100000:2.0:1788592680.845805:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788592680.845811:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225950592:12345-0@lo:503: 00000100:00100000:2.0:1788592680.846095:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225950592:12345-0@lo:503: Request processed in 282us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.846102:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788592680.846140:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225950592:0@lo:503: 00000100:00100000:0.0:1788592680.850110:0:10031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10031:1875475225950720:0@lo:502: 00000100:00100000:2.0:1788592680.850233:0:10031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.850271:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950720 00000100:00100000:2.0:1788592680.850278:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950720 00000100:00100000:2.0:1788592680.850324:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788592680.850334:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10031:x1875475225950720:12345-0@lo:502: 00000100:00100000:2.0:1788592680.850452:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10031:x1875475225950720:12345-0@lo:502: Request processed in 118us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.850459:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788592680.850509:0:10031:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.850526:0:10031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10031:1875475225950720:0@lo:502: 00000020:01000000:2.0:1788592680.850552:0:10031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592680.850559:0:10031:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788592680.850566:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592680.850568:0:10031:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788592680.850572:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592680.850576:0:10031:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1788592680.850595:0:10031:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788592680.850597:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592680.850610:0:10031:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff921743508000) 00000020:00000080:2.0:1788592680.850632:0:10031:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788592680.850638:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592680.850713:0:10031:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788592680.850718:0:10031:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788592680.850725:0:10031:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db4ca5 00010000:00080000:2.0:1788592680.850750:0:10031:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921876712000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592680.851408:0:10031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788592680.851524:0:10031:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788592680.851535:0:10031:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788592680.851690:0:10031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592680.851795:0:10031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592680.851930:0:10031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788592680.852026:0:10031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788592680.853107:0:10032:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592680.853114:0:10032:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788592680.854783:0:10031:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592680.854795:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788592680.854837:0:10031:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788592680.854863:0:10031:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db4cac 00000100:00080000:2.0:1788592680.854880:0:10031:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592680.854885:0:10031:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff921876712000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592680.855337:0:10031:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921741dda300 x1875475225950848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592680.855363:0:10031:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788592680.855420:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225950848:0@lo:8: 00000020:01000000:2.0:1788592680.855433:0:10031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592680.855436:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592680.855438:0:10031:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788592680.855440:0:10031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592680.855444:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592680.855445:0:10031:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788592680.855447:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788592680.855449:0:10031:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788592680.855470:0:10031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10031:1875475225950976:0@lo:502: 00000100:00100000:0.0:1788592680.855489:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.855507:0:10031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.855532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950976 00000100:00100000:0.0:1788592680.855536:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225950848 00000100:00100000:2.0:1788592680.855538:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950976 00000100:00100000:0.0:1788592680.855538:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225950848 00000100:00100000:2.0:1788592680.855563:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788592680.855564:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592680.855570:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10031:x1875475225950976:12345-0@lo:502: 00000100:00100000:0.0:1788592680.855570:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475225950848:12345-0@lo:8: 00010000:00080000:0.0:1788592680.855592:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1788592680.855616:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db4cb3 00002000:00100000:0.0:1788592680.855629:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9217434f3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788592680.855632:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788592680.855635:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788592680.855667:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10031:x1875475225950976:12345-0@lo:502: Request processed in 96us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.855674:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00002000:00080000:0.0:1788592680.855689:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788592680.855708:0:10031:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845433cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788592680.855709:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9217434f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592680.855724:0:10031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10031:1875475225950976:0@lo:502: 00000100:00100000:0.0:1788592680.855741:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875475225950848:12345-0@lo:8: Request processed in 171us (251us total) trans 0 rc 0/0 00000020:01000000:2.0:1788592680.855745:0:10031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788592680.855747:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1788592680.855748:0:10031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592680.855750:0:10031:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788592680.855752:0:10031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:0.0:1788592680.855775:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741dda300 x1875475225950848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.855783:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592680.855789:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000020:01000000:2.0:1788592680.855794:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00000100:00080000:0.0:1788592680.855801:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788592680.855805:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788592680.855807:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921876712000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788592680.855814:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 10000000:01000000:2.0:1788592680.855815:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:0.0:1788592680.855818:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475225950848:0@lo:8: 00010000:00010000:2.0:1788592680.855824:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592680.855836:0:10032:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1788592680.855839:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592680.855848:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788592680.855850:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff921850ee4d40 from 1 10000000:01000000:2.0:1788592680.855853:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:0.0:1788592680.855878:0:10032:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 215102810636ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788592680.855884:0:10032:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1788592680.855887:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.855895:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.855903:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.856036:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225951104:0@lo:101: 00000100:00100000:2.0:1788592680.856064:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.856098:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592680.856106:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951104 00000100:00100000:0.0:1788592680.856111:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951104 00000100:00100000:0.0:1788592680.856136:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788592680.856142:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225951104:12345-0@lo:101: 00010000:00010000:0.0:1788592680.856150:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592680.856160:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4cba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.856180:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4cba expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.856189:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4cba expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592680.856197:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841495800, rc 0) 00000100:00100000:0.0:1788592680.856236:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225951104:12345-0@lo:101: Request processed in 93us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.856242:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 40000000:02000000:3.0:1788592680.857425:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788592680.859147:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225951104:0@lo:101: 00010000:00010000:2.0:1788592680.859177:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.859193:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592680.859292:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225951232:0@lo:501: 00000100:00100000:2.0:1788592680.859354:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.859413:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.859438:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951232 00000100:00100000:2.0:1788592680.859443:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951232 00000100:00100000:2.0:1788592680.859488:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788592680.859496:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225951232:12345-0@lo:501: 00000100:00100000:2.0:1788592680.859587:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225951232:12345-0@lo:501: Request processed in 91us (232us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592680.859595:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788592680.859631:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225951232:0@lo:501: 10000000:01000000:2.0:1788592680.859656:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788592680.859663:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592680.859673:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592680.866150:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788592680.866257:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225951360:0@lo:13: 00000100:00100000:0.0:1788592680.866322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788592680.866457:0:10033:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788592680.866478:0:10033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225951488:0@lo:7: 00000100:00100000:0.0:1788592680.866504:0:10033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.866528:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951488 00000100:00100000:0.0:1788592680.866535:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951488 00000100:00100000:0.0:1788592680.866581:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788592680.866589:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10033:x1875475225951488:12345-0@lo:7: 00000100:00080000:2.0:1788592680.868926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592680.869127:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951360 00000100:00100000:2.0:1788592680.869136:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951360 00000100:00100000:2.0:1788592680.869184:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592680.869193:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875475225951360:12345-0@lo:13: 00002000:00000024:2.0:1788592680.869219:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:2.0:1788592680.869289:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875475225951360:12345-0@lo:13: Request processed in 97us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.869297:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788592680.869343:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f484a80 x1875475225951360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592680.869364:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225951360:0@lo:13: 00000100:00100000:1.0:1788592680.872394:0:10033:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592680.879693:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1875475225950208:12345-0@lo:700: Request processed in 35458us (36241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.879707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788592680.880025:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f3100 x1875475225950208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592680.880040:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1875475225950208:0@lo:700: 40000000:02000000:2.0:1788592680.880053:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00002000:00080000:0.0:1788592680.880887:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788592680.880893:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788592680.881153:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10033:x1875475225951488:12345-0@lo:7: Request processed in 14562us (14645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592680.881164:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788592680.884180:0:10033:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b6d80 x1875475225951488/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.884200:0:10033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225951488:0@lo:7: 00000004:00080000:1.0:1788592680.884216:0:10033:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00010000:00010000:3.0:1788592680.891588:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592680.892267:0:10033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225951616:0@lo:5: 00000100:00100000:0.0:1788592680.892330:0:10033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.892361:0:10033:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.893235:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951616 00000100:00100000:2.0:1788592680.893245:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951616 00000100:00100000:2.0:1788592680.893311:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592680.893321:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10033:x1875475225951616:12345-0@lo:5: 00002000:00080000:2.0:1788592680.893348:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788592680.893352:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00100000:0.0:1788592680.899635:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788592680.899646:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788592680.899805:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10026:x1875475225950080:12345-0@lo:700: Request processed in 56437us (60083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.899823:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788592680.900387:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f484000 x1875475225950080/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.900402:0:10026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225950080:0@lo:700: 00000100:00100000:2.0:1788592680.903824:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10033:x1875475225951616:12345-0@lo:5: Request processed in 10498us (11487us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788592680.903838:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788592680.905275:0:10033:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b7b80 x1875475225951616/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.905294:0:10033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225951616:0@lo:5: 00000004:00080000:0.0:1788592680.905309:0:10033:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788592680.905349:0:10033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225951744:0@lo:700: 00000100:00100000:0.0:1788592680.905420:0:10033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592680.905451:0:10033:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592680.905557:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951744 00000100:00100000:2.0:1788592680.905563:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951744 00000100:00100000:2.0:1788592680.905615:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592680.905624:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10033:x1875475225951744:12345-0@lo:700: 00000004:00080000:1.0:1788592680.909613:0:10026:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788592680.909660:0:10026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225952000:0@lo:7: 00000100:00100000:1.0:1788592680.909737:0:10026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.909767:0:10026:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858657240 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.909786:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952000 00000100:00100000:1.0:1788592680.909792:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952000 00000100:00100000:1.0:1788592680.909838:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592680.909846:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10026:x1875475225952000:12345-0@lo:7: 00000100:00100000:2.0:1788592680.910362:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225951872:0@lo:13: 00000100:00100000:2.0:1788592680.910414:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.910455:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225951872 00000100:00100000:2.0:1788592680.910458:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225951872 00000100:00100000:2.0:1788592680.910486:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592680.910493:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875475225951872:12345-0@lo:13: 00002000:00000024:2.0:1788592680.910505:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:2.0:1788592680.910545:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875475225951872:12345-0@lo:13: Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592680.910561:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788592680.910605:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b8ca80 x1875475225951872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592680.910622:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225951872:0@lo:13: 00000001:00080000:0.0:1788592680.914431:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788592680.914662:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10033:x1875475225951744:12345-0@lo:700: Request processed in 9034us (9237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592680.914677:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788592680.915163:0:10033:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b5180 x1875475225951744/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592680.915175:0:10033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788592680.915191:0:10033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225951744:0@lo:700: 00002000:00080000:1.0:1788592680.919258:0:8590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788592680.919267:0:8590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788592680.919350:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10026:x1875475225952000:12345-0@lo:7: Request processed in 9501us (9610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.919360:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788592680.919423:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b20000 x1875475225952000/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.919439:0:10026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225952000:0@lo:7: 00000004:00080000:1.0:1788592680.919452:0:10026:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788592680.919488:0:10026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225952128:0@lo:5: 00000100:00100000:1.0:1788592680.919518:0:10026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.919541:0:10026:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858657240 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.919559:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952128 00000100:00100000:1.0:1788592680.919565:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952128 00000100:00100000:1.0:1788592680.919603:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788592680.919612:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10026:x1875475225952128:12345-0@lo:5: 00002000:00080000:1.0:1788592680.919635:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788592680.919665:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10026:x1875475225952128:12345-0@lo:5: Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.919671:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788592680.919693:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b20000 x1875475225952128/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.919710:0:10026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225952128:0@lo:5: 00000004:00080000:1.0:1788592680.919718:0:10026:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788592680.919740:0:10026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225952256:0@lo:5: 00000100:00100000:1.0:1788592680.919762:0:10026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.919777:0:10026:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858657240 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.919790:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952256 00000100:00100000:1.0:1788592680.919793:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952256 00000100:00100000:1.0:1788592680.919813:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592680.919819:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10026:x1875475225952256:12345-0@lo:5: 00002000:00080000:1.0:1788592680.919839:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788592680.922054:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10026:x1875475225952256:12345-0@lo:5: Request processed in 2228us (2285us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788592680.922086:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788592680.922193:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b20000 x1875475225952256/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.922210:0:10026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10026:1875475225952256:0@lo:5: 00000004:00080000:1.0:1788592680.922225:0:10026:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788592680.922261:0:10026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b23480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10026:1875475225952384:0@lo:900: 00000100:00100000:1.0:1788592680.922293:0:10026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592680.922316:0:10026:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba31600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.922342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952384 00000100:00100000:1.0:1788592680.922346:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952384 00000100:00100000:1.0:1788592680.922394:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592680.922403:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10026:x1875475225952384:12345-0@lo:900: 00000100:00100000:1.0:1788592680.922462:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10026:x1875475225952384:12345-0@lo:900: Request processed in 60us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592680.922469:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788592680.922498:0:10026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b23480 x1875475225952384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592680.922508:0:10026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b23480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10026:1875475225952384:0@lo:900: 00000004:02000040:2.0:1788592680.923022:0:10033:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788592680.926772:0:10033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225952512:0@lo:5: 00000100:00100000:2.0:1788592680.926838:0:10033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592680.926927:0:10033:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592680.927432:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952512 00000100:00100000:1.0:1788592680.927440:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952512 00000100:00100000:1.0:1788592680.927532:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592680.927542:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10033:x1875475225952512:12345-0@lo:5: 00002000:00080000:1.0:1788592680.933223:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788592680.933245:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788592680.935550:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10033:x1875475225952512:12345-0@lo:5: Request processed in 8004us (8705us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788592680.935562:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788592680.935630:0:10033:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741ddb480 x1875475225952512/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592680.935647:0:10033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10033:1875475225952512:0@lo:5: 00000004:00080000:0.0:1788592680.935663:0:10033:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:2.0:1788592681.664756:0:10078:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788592681.664776:0:10078:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788592681.784285:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592681.784308:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225952640:0@lo:13: 00000100:00100000:3.0:1788592681.784389:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592681.784444:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952640 00000100:00100000:3.0:1788592681.784451:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952640 00000100:00100000:3.0:1788592681.784506:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592681.784527:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225952640:12345-0@lo:13: 00002000:00000024:3.0:1788592681.784556:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592681.784608:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225952640:12345-0@lo:13: Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592681.784615:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788592681.784655:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437daa00 x1875475225952640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592681.784673:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225952640:0@lo:13: 00000100:00100000:3.0:1788592681.784960:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225952768:0@lo:13: 00000100:00100000:3.0:1788592681.784989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592681.785018:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952768 00000100:00100000:3.0:1788592681.785033:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952768 00000100:00100000:3.0:1788592681.785056:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592681.785063:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225952768:12345-0@lo:13: 00002000:00000024:3.0:1788592681.785170:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592681.785215:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225952768:12345-0@lo:13: Request processed in 152us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592681.785221:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788592681.786236:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437daa00 x1875475225952768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592681.786256:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225952768:0@lo:13: 00010000:00010000:3.0:1788592681.912453:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592682.181963:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.182133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126016 00000100:00100000:2.0:1788592682.182149:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126016 00000100:00100000:2.0:1788592682.182201:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 180 00000100:00100000:2.0:1788592682.182209:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875475209126016:12345-192.168.203.47@tcp:250: 00010000:00080000:2.0:1788592682.182234:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9fde4749-eba3-4045-af7c-c124eb85a251@192.168.203.47@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1788592682.182261:0:6505:0:(genops.c:1385:class_connect()) connect: client 9fde4749-eba3-4045-af7c-c124eb85a251, cookie 0xbd314a3362db4cc8 00000100:00080000:2.0:1788592682.182937:0:6505:0:(import.c:65:import_set_state_nolock()) ffff92186f49b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592682.183117:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+5:2392:x1875475209126016:12345-192.168.203.47@tcp:250: Request processed in 906us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.183127:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 180 00000100:00100000:3.0:1788592682.196667:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592682.196737:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126144 00000100:00100000:0.0:1788592682.196748:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126144 00000100:00100000:0.0:1788592682.196993:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 181 00000100:00100000:0.0:1788592682.197004:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+5:6148:x1875475209126144:12345-192.168.203.47@tcp:101: 00010000:00010000:0.0:1788592682.197019:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592682.197034:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592682.197060:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592682.197120:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592682.197128:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841494800, rc 0) 00000100:00100000:0.0:1788592682.197185:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+6:6148:x1875475209126144:12345-192.168.203.47@tcp:101: Request processed in 183us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592682.197191:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 181 00000100:00100000:3.0:1788592682.199743:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.210682:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126272 00000100:00100000:2.0:1788592682.210714:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126272 00000100:00100000:2.0:1788592682.210841:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:2.0:1788592682.210852:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+6:6148:x1875475209126272:12345-192.168.203.47@tcp:501: 00000100:00100000:2.0:1788592682.210977:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+6:6148:x1875475209126272:12345-192.168.203.47@tcp:501: Request processed in 127us (11247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592682.210985:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:3.0:1788592682.217215:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.217416:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126400 00000100:00100000:2.0:1788592682.217426:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126400 00000100:00100000:2.0:1788592682.217483:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 183 00000100:00100000:2.0:1788592682.217494:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+6:6148:x1875475209126400:12345-192.168.203.47@tcp:101: 00010000:00010000:2.0:1788592682.217508:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592682.217525:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2c39 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592682.217554:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592682.217565:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592682.217574:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80200, rc 0) 00000100:00100000:2.0:1788592682.217628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+7:6148:x1875475209126400:12345-192.168.203.47@tcp:101: Request processed in 137us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.217635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 183 00000100:00100000:3.0:1788592682.219682:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592682.219882:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126528 00000100:00100000:1.0:1788592682.219891:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126528 00000100:00100000:1.0:1788592682.224999:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 184 00000100:00100000:1.0:1788592682.225033:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+7:6148:x1875475209126528:12345-192.168.203.47@tcp:501: 00000100:00100000:3.0:1788592682.226816:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+8:6148:x1875475209126528:12345-192.168.203.47@tcp:501: Request processed in 1794us (7133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592682.226829:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 184 00000100:00100000:3.0:1788592682.230184:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592682.230847:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126656 00000100:00100000:1.0:1788592682.230857:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126656 00000100:00100000:1.0:1788592682.230917:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 185 00000100:00100000:1.0:1788592682.230928:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+8:6148:x1875475209126656:12345-192.168.203.47@tcp:503: 00000100:00100000:1.0:1788592682.231161:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+8:6148:x1875475209126656:12345-192.168.203.47@tcp:503: Request processed in 234us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592682.231169:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 185 00000100:00100000:3.0:1788592682.244516:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.244626:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126784 00000100:00100000:2.0:1788592682.244641:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126784 00000100:00100000:2.0:1788592682.244710:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 186 00000100:00100000:2.0:1788592682.244720:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+8:6167:x1875475209126784:12345-192.168.203.47@tcp:502: 00000100:00100000:2.0:1788592682.244910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+8:6167:x1875475209126784:12345-192.168.203.47@tcp:502: Request processed in 190us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.244918:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 186 00000100:00100000:3.0:1788592682.301686:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.307446:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209126912 00000100:00100000:2.0:1788592682.307471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209126912 00000100:00100000:2.0:1788592682.307576:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 187 00000100:00100000:2.0:1788592682.307588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+8:6167:x1875475209126912:12345-192.168.203.47@tcp:502: 00000100:00100000:2.0:1788592682.307797:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+8:6167:x1875475209126912:12345-192.168.203.47@tcp:502: Request processed in 210us (6125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.307807:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 187 00000100:00100000:3.0:1788592682.313978:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592682.315834:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127040 00000100:00100000:1.0:1788592682.315852:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127040 00000100:00100000:1.0:1788592682.316185:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 188 00000100:00100000:1.0:1788592682.316199:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+8:6148:x1875475209127040:12345-192.168.203.47@tcp:101: 00010000:00010000:1.0:1788592682.316222:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592682.316245:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839000/0xbd314a3362db4cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2c6a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592682.316280:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839000/0xbd314a3362db4cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c6a expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592682.316293:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839000/0xbd314a3362db4cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c6a expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592682.316305:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839000, rc 0) 00000100:00100000:1.0:1788592682.316397:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6148:x1875475209127040:12345-192.168.203.47@tcp:101: Request processed in 201us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592682.316404:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 188 00000100:00100000:0.0:1788592682.320735:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592682.321203:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127168 00000100:00100000:3.0:1788592682.321217:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127168 00000100:00100000:3.0:1788592682.321477:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 189 00000100:00100000:3.0:1788592682.321491:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+9:6148:x1875475209127168:12345-192.168.203.47@tcp:256: 20000000:01000000:3.0:1788592682.321525:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788592682.321557:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788592682.321561:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788592682.321564:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788592682.321573:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788592682.321576:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788592682.336437:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+9:6148:x1875475209127168:12345-192.168.203.47@tcp:256: Request processed in 14932us (15699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.336458:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 189 00000100:00100000:0.0:1788592682.340358:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592682.340539:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127296 00000100:00100000:1.0:1788592682.340553:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127296 00000100:00100000:1.0:1788592682.340626:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 190 00000100:00100000:1.0:1788592682.340638:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6148:x1875475209127296:12345-192.168.203.47@tcp:101: 00010000:00010000:1.0:1788592682.340660:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592682.340684:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2c71 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592682.340728:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592682.340741:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592682.340753:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839800, rc 0) 00000100:00100000:1.0:1788592682.340829:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6148:x1875475209127296:12345-192.168.203.47@tcp:101: Request processed in 193us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592682.340837:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 190 00000100:00100000:0.0:1788592682.348968:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.349199:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127424 00000100:00100000:2.0:1788592682.349214:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127424 00000100:00100000:2.0:1788592682.349302:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 191 00000100:00100000:2.0:1788592682.349314:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:6148:x1875475209127424:12345-192.168.203.47@tcp:501: 00000100:00100000:2.0:1788592682.349539:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:6148:x1875475209127424:12345-192.168.203.47@tcp:501: Request processed in 226us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.349549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 191 00000100:00100000:3.0:1788592682.352004:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.352188:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127552 00000100:00100000:2.0:1788592682.352201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127552 00000100:00100000:2.0:1788592682.352436:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:2.0:1788592682.352451:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6148:x1875475209127552:12345-192.168.203.47@tcp:503: 00000100:00100000:2.0:1788592682.352640:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6148:x1875475209127552:12345-192.168.203.47@tcp:503: Request processed in 192us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.352657:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:0.0:1788592682.362267:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592682.362374:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127680 00000100:00100000:1.0:1788592682.362388:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127680 00000100:00100000:1.0:1788592682.362462:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 193 00000100:00100000:1.0:1788592682.362475:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6174:x1875475209127680:12345-192.168.203.47@tcp:502: 00000100:00100000:1.0:1788592682.362697:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6174:x1875475209127680:12345-192.168.203.47@tcp:502: Request processed in 223us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592682.362706:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 193 00000100:00100000:0.0:1788592682.365389:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.366013:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127808 00000100:00100000:2.0:1788592682.366027:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127808 00000100:00100000:2.0:1788592682.366211:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 194 00000100:00100000:2.0:1788592682.366226:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6174:x1875475209127808:12345-192.168.203.47@tcp:502: 00000100:00100000:2.0:1788592682.366429:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6174:x1875475209127808:12345-192.168.203.47@tcp:502: Request processed in 206us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.366437:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 194 00000100:00100000:0.0:1788592682.375579:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592682.375636:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592682.378577:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209127936 00000100:00100000:2.0:1788592682.378599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209127936 00000100:00100000:3.0:1788592682.383027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128192 00000100:00100000:3.0:1788592682.383046:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128192 00000100:00100000:1.0:1788592682.383247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:1.0:1788592682.383258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875475209128192:12345-192.168.203.47@tcp:38: 00010000:00080000:1.0:1788592682.383299:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1788592682.383379:0:6514:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db4ceb 00000004:00100000:1.0:1788592682.383413:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788592682.383714:0:6514:0:(import.c:65:import_set_state_nolock()) ffff921742828000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592682.384135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209128192:12345-192.168.203.47@tcp:38: Request processed in 875us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592682.384158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:0.0:1788592682.384747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:0.0:1788592682.384756:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875475209127936:12345-192.168.203.47@tcp:38: 00010000:00080000:0.0:1788592682.384796:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788592682.384846:0:6512:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db4cf2 00000004:00100000:0.0:1788592682.384896:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788592682.385411:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9217434f5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592682.385469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209127936:12345-192.168.203.47@tcp:38: Request processed in 711us (9906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592682.385477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00010000:00010000:1.0:1788592682.936429:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592683.401053:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592683.401194:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128448 00000100:00100000:3.0:1788592683.401208:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128448 00000100:00100000:3.0:1788592683.401376:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:3.0:1788592683.401387:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209128448:12345-192.168.203.47@tcp:41: 00000004:00000024:3.0:1788592683.401441:0:10029:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788592683.401535:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209128448:12345-192.168.203.47@tcp:41: Request processed in 150us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592683.401543:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00080000:2.0:1788592683.404795:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592683.407822:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592683.407918:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592683.414168:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128064 00000100:00100000:3.0:1788592683.414192:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128064 00000100:00100000:0.0:1788592683.414519:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592683.423314:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128320 00000100:00100000:1.0:1788592683.423337:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128320 00000100:00100000:1.0:1788592683.423455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128576 00000100:00100000:1.0:1788592683.423458:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128576 00000100:00100000:1.0:1788592683.423486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:1.0:1788592683.423497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:0:x1875475209128064:12345-192.168.203.47@tcp:41: 00000004:00000024:1.0:1788592683.423554:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788592683.423656:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:0:x1875475209128064:12345-192.168.203.47@tcp:41: Request processed in 160us (15850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592683.423665:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:1.0:1788592683.423692:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:1.0:1788592683.423699:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:0:x1875475209128320:12345-192.168.203.47@tcp:41: 00000004:00000024:1.0:1788592683.423721:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788592683.423750:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:0:x1875475209128320:12345-192.168.203.47@tcp:41: Request processed in 52us (15832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592683.423756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:1.0:1788592683.423769:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:1.0:1788592683.423776:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209128576:12345-192.168.203.47@tcp:40: 00000100:00100000:1.0:1788592683.423806:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209128576:12345-192.168.203.47@tcp:40: Request processed in 30us (9295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592683.423812:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00080000:1.0:1788592683.424542:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592683.429949:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592683.430162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592683.432244:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592683.432327:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592683.432434:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128960 00000100:00100000:3.0:1788592683.432448:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128960 00000100:00100000:3.0:1788592683.432595:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1788592683.432820:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209128960:12345-192.168.203.47@tcp:900: 00000100:00100000:1.0:1788592683.432920:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128704 00000100:00100000:1.0:1788592683.432940:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128704 00000100:00100000:3.0:1788592683.433895:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209128960:12345-192.168.203.47@tcp:900: Request processed in 1075us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592683.433909:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1788592683.435336:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129088 00000100:00100000:3.0:1788592683.435363:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129088 00000100:00100000:3.0:1788592683.435455:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 195 00000100:00100000:3.0:1788592683.435532:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2394:x1875475209129088:12345-192.168.203.47@tcp:400: 00000100:00100000:3.0:1788592683.435762:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2394:x1875475209129088:12345-192.168.203.47@tcp:400: Request processed in 296us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592683.435793:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 195 00000100:00100000:1.0:1788592683.436171:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209128832 00000100:00100000:1.0:1788592683.436178:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209128832 00000100:00100000:1.0:1788592683.436209:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:1.0:1788592683.436216:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875475209128704:12345-192.168.203.47@tcp:8: 00010000:00080000:1.0:1788592683.436250:0:8590:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1788592683.436286:0:8590:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db4cf9 00002000:00100000:1.0:1788592683.436302:0:8590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7fa053f8-dea8-45a9-81cb-9946b4fa9e00/ffff92174282f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592683.436318:0:8590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788592683.437229:0:8590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788592683.437279:0:8590:0:(import.c:65:import_set_state_nolock()) ffff92174282a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592683.437344:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209128704:12345-192.168.203.47@tcp:8: Request processed in 1125us (7409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592683.437365:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:1.0:1788592683.437392:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:1.0:1788592683.437399:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875475209128832:12345-192.168.203.47@tcp:8: 00010000:00080000:1.0:1788592683.437425:0:8590:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1788592683.437449:0:8590:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db4d00 00002000:00100000:1.0:1788592683.437460:0:8590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7fa053f8-dea8-45a9-81cb-9946b4fa9e00/ffff92174282b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592683.437549:0:8590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788592683.437949:0:8590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788592683.437970:0:8590:0:(import.c:65:import_set_state_nolock()) ffff92174282c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592683.438001:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209128832:12345-192.168.203.47@tcp:8: Request processed in 601us (7840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592683.438009:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:1.0:1788592683.443408:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592683.443732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129216 00000100:00100000:2.0:1788592683.443746:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129216 00000100:00100000:2.0:1788592683.443815:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:2.0:1788592683.443835:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209129216:12345-192.168.203.47@tcp:33: 00000004:00080000:2.0:1788592683.469976:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25363us 00000004:00200000:2.0:1788592683.494915:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788592683.495028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6148:x1875475209129216:12345-192.168.203.47@tcp:33: Request processed in 51191us (51630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592683.495039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:1.0:1788592683.728956:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592683.729114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129344 00000100:00100000:0.0:1788592683.729124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129344 00000100:00100000:0.0:1788592683.729186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:0.0:1788592683.729197:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6192:x1875475209129344:12345-192.168.203.47@tcp:101: 00010000:00010000:0.0:1788592683.729216:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592683.729315:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841495000/0xbd314a3362db4d07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ca2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592683.729398:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db4d0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592683.729415:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db4d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592683.729430:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db4d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592683.729476:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592683.729480:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592683.729541:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db4d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592683.729582:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841495000/0xbd314a3362db4d07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ca2 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592683.729614:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db4d0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ca2 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592683.729638:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:0.0:1788592683.729641:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592683.729644:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841494200, rc 0) 00000100:00100000:0.0:1788592683.729745:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:6192:x1875475209129344:12345-192.168.203.47@tcp:101: Request processed in 550us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592683.729766:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:3.0:1788592683.832379:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592683.832415:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225952896:0@lo:41: 00000100:00100000:3.0:1788592683.832490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592683.832700:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225952896 00000100:00100000:2.0:1788592683.832709:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225952896 00000100:00100000:2.0:1788592683.832765:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592683.832774:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225952896:12345-0@lo:41: 00000004:00000024:2.0:1788592683.832804:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788592683.832858:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225952896:12345-0@lo:41: Request processed in 85us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592683.832879:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788592683.832969:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225952896:0@lo:41: 00000100:00100000:2.0:1788592683.834151:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225953024:0@lo:41: 00000100:00100000:2.0:1788592683.834206:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592683.834297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953024 00000100:00100000:3.0:1788592683.834303:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953024 00000100:00100000:3.0:1788592683.834345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788592683.834363:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225953024:12345-0@lo:41: 00000004:00000024:3.0:1788592683.834388:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592683.834566:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225953024:12345-0@lo:41: Request processed in 212us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592683.834573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788592683.834784:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225953024:0@lo:41: 00010000:00010000:3.0:1788592683.960295:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592684.984266:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592685.881269:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592685.881292:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225953152:0@lo:13: 00000100:00100000:3.0:1788592685.881397:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592685.881564:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953152 00000100:00100000:2.0:1788592685.881572:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953152 00000100:00100000:2.0:1788592685.881638:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592685.881648:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475225953152:12345-0@lo:13: 00002000:00000024:2.0:1788592685.881674:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592685.881720:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475225953152:12345-0@lo:13: Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592685.881728:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788592685.881972:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788592685.882004:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b8ca80 x1875475225953152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592685.882023:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225953152:0@lo:13: 00000100:00100000:3.0:1788592685.883044:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225953280:0@lo:400: 00000100:00100000:3.0:1788592685.883113:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592685.883140:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225953792:0@lo:400: 00000100:00100000:3.0:1788592685.883176:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592685.883192:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225954304:0@lo:400: 00000100:00100000:3.0:1788592685.883213:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592685.883231:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788592685.883236:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225953664:0@lo:400: 00000100:00100000:3.0:1788592685.883258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592685.883273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225954176:0@lo:400: 00000100:00100000:3.0:1788592685.883292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592685.883306:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225954688:0@lo:400: 00000100:00100000:3.0:1788592685.883325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.883501:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225953408:0@lo:400: 00000100:00100000:0.0:1788592685.883537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.883565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225953920:0@lo:400: 00000100:00100000:0.0:1788592685.883584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.883598:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225954432:0@lo:400: 00000100:00100000:0.0:1788592685.883778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.883799:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592685.883806:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225953536:0@lo:400: 00000100:00100000:0.0:1788592685.883828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.883842:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225954048:0@lo:400: 00000100:00100000:3.0:1788592685.883946:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953664 00000100:00100000:3.0:1788592685.883953:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953664 00000100:00100000:3.0:1788592685.883989:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953536 00000100:00100000:3.0:1788592685.883992:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953536 00000100:00100000:3.0:1788592685.884007:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592685.884015:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225953664:12345-0@lo:400: 00000100:00100000:3.0:1788592685.884064:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225953664:12345-0@lo:400: Request processed in 49us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.884087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592685.884103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788592685.884108:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225953536:12345-0@lo:400: 00000100:00100000:3.0:1788592685.884136:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225953536:12345-0@lo:400: Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.884141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788592685.884172:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225953664:0@lo:400: 00000100:00100000:3.0:1788592685.884198:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953792 00000100:00100000:3.0:1788592685.884208:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953792 00000100:00100000:3.0:1788592685.884228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953408 00000100:00100000:3.0:1788592685.884231:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953408 00000100:00100000:3.0:1788592685.884239:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953920 00000100:00100000:3.0:1788592685.884241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953920 00000100:00100000:3.0:1788592685.884260:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954432 00000100:00100000:3.0:1788592685.884262:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954432 00000100:00100000:3.0:1788592685.884276:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592685.884282:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225953792:12345-0@lo:400: 00000100:00100000:3.0:1788592685.884318:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225953792:12345-0@lo:400: Request processed in 36us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.884324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592685.884348:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592685.884355:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225953408:12345-0@lo:400: 00000100:00100000:3.0:1788592685.884382:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225953408:12345-0@lo:400: Request processed in 29us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.884388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592685.884398:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592685.884403:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225953920:12345-0@lo:400: 00000100:00100000:3.0:1788592685.884427:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225953920:12345-0@lo:400: Request processed in 24us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.884432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592685.884443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592685.884448:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225954432:12345-0@lo:400: 00000100:00100000:3.0:1788592685.884487:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225954432:12345-0@lo:400: Request processed in 39us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.884493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788592685.884509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592685.884536:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225953792:0@lo:400: 00000100:00100000:0.0:1788592685.884769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.884796:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225954560:0@lo:400: 00000100:00100000:0.0:1788592685.884817:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592685.884840:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225953408:0@lo:400: 00000100:00100000:3.0:1788592685.884942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954048 00000100:00100000:3.0:1788592685.884947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954048 00000100:00100000:3.0:1788592685.884972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954560 00000100:00100000:3.0:1788592685.884975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954560 00000100:00100000:3.0:1788592685.884990:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592685.884995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225954048:12345-0@lo:400: 00000100:00100000:1.0:1788592685.885101:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954304 00000100:00100000:1.0:1788592685.885105:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954304 00000100:00100000:1.0:1788592685.885133:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954176 00000100:00100000:1.0:1788592685.885136:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954176 00000100:00100000:1.0:1788592685.885149:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954688 00000100:00100000:1.0:1788592685.885151:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954688 00000100:00100000:1.0:1788592685.885165:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592685.885171:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225954304:12345-0@lo:400: 00000100:00100000:0.0:1788592685.885225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225953920:0@lo:400: 00000100:00100000:2.0:1788592685.885296:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592685.885305:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225954176:12345-0@lo:400: 00000100:00100000:3.0:1788592685.885380:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225954048:12345-0@lo:400: Request processed in 384us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.885386:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592685.885399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788592685.885404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225954560:12345-0@lo:400: 00000100:00100000:3.0:1788592685.885430:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225954560:12345-0@lo:400: Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.885435:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788592685.885449:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592685.885465:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592685.885468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592685.885499:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225953280 00000100:00100000:3.0:1788592685.885504:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225953280 00000100:00100000:3.0:1788592685.885535:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788592685.885542:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225953280:12345-0@lo:400: 00000100:00100000:3.0:1788592685.885577:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225953280:12345-0@lo:400: Request processed in 36us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.885598:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788592685.885644:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225953280:0@lo:400: 00000100:00100000:3.0:1788592685.885689:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788592685.885705:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788592685.885806:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592685.885814:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875475225954688:12345-0@lo:400: 00000100:00100000:3.0:1788592685.885861:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875475225954688:12345-0@lo:400: Request processed in 48us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.885867:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788592685.885896:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f509880 x1875475225954688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592685.885907:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225954688:0@lo:400: 00000100:00100000:1.0:1788592685.892918:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225954304:12345-0@lo:400: Request processed in 7737us (9693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592685.892933:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788592685.893756:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d50bb80 x1875475225954304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592685.893773:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225954304:0@lo:400: 00000100:00100000:0.0:1788592685.895931:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225954432:0@lo:400: 00000100:00100000:0.0:1788592685.895978:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225953536:0@lo:400: 00010000:00080000:0.0:1788592685.895993:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d509c00 x1875475225954048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592685.896003:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225954048:0@lo:400: 00010000:00080000:0.0:1788592685.896014:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d50ad80 x1875475225954560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592685.896021:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225954560:0@lo:400: 00000100:00100000:2.0:1788592685.899699:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225954176:12345-0@lo:400: Request processed in 14387us (16397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592685.899714:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788592685.903465:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d508a80 x1875475225954176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592685.903485:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225954176:0@lo:400: 00000100:00100000:1.0:1788592685.912233:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592685.912296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129472 00000100:00100000:3.0:1788592685.912306:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129472 00000100:00100000:3.0:1788592685.912388:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:3.0:1788592685.912397:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:6245:x1875475209129472:12345-192.168.203.47@tcp:41: 00000004:00000024:3.0:1788592685.912433:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788592685.912499:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:6245:x1875475209129472:12345-192.168.203.47@tcp:41: Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.912507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00080000:0.0:1788592685.915768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592685.921631:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592685.921735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129600 00000100:00100000:3.0:1788592685.921748:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129600 00000100:00100000:3.0:1788592685.921874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:3.0:1788592685.921886:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6245:x1875475209129600:12345-192.168.203.47@tcp:41: 00000100:00080000:0.0:1788592685.922015:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1788592685.922233:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592685.922378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6245:x1875475209129600:12345-192.168.203.47@tcp:41: Request processed in 493us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592685.922387:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:1.0:1788592685.929392:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592685.929591:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129728 00000100:00100000:2.0:1788592685.929604:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129728 00000100:00100000:2.0:1788592685.929753:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:2.0:1788592685.929773:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6245:x1875475209129728:12345-192.168.203.47@tcp:13: 00002000:00000024:2.0:1788592685.929824:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592685.929902:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6245:x1875475209129728:12345-192.168.203.47@tcp:13: Request processed in 132us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592685.929911:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00080000:0.0:1788592685.929975:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592685.935046:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592685.935254:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129856 00000100:00100000:3.0:1788592685.935268:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129856 00000100:00100000:2.0:1788592685.935497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:2.0:1788592685.935510:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6245:x1875475209129856:12345-192.168.203.47@tcp:13: 00002000:00000024:2.0:1788592685.935564:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592685.935651:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:6245:x1875475209129856:12345-192.168.203.47@tcp:13: Request processed in 142us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592685.935659:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00080000:0.0:1788592685.936354:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788592686.011023:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592686.397256:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225954816:0@lo:13: 00000100:00100000:3.0:1788592686.397368:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592686.401273:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954816 00000100:00100000:3.0:1788592686.401292:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954816 00000100:00100000:3.0:1788592686.401401:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592686.401412:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875475225954816:12345-0@lo:13: 00002000:00000024:3.0:1788592686.401449:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592686.401556:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875475225954816:12345-0@lo:13: Request processed in 147us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592686.401563:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788592686.401640:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b22a00 x1875475225954816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592686.401665:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225954816:0@lo:13: 00000100:00100000:3.0:1788592686.904286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225954944:0@lo:13: 00000100:00100000:3.0:1788592686.904410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592686.904482:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592686.904493:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225955072:0@lo:13: 00000100:00100000:3.0:1788592686.904529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592686.904586:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225954944 00000100:00100000:3.0:1788592686.904588:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955072 00000100:00100000:3.0:1788592686.904599:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955072 00000100:00100000:2.0:1788592686.904602:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225954944 00000100:00100000:3.0:1788592686.904665:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592686.904680:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225955072:12345-0@lo:13: 00002000:00000024:3.0:1788592686.904725:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592686.904786:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225955072:12345-0@lo:13: Request processed in 109us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592686.904795:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592686.904821:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788592686.904829:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225954944:12345-0@lo:13: 00002000:00000024:3.0:1788592686.904841:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592686.904867:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225954944:12345-0@lo:13: Request processed in 39us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592686.904873:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788592686.906651:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b8ca80 x1875475225955072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592686.907396:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225955072:0@lo:13: 00010000:00080000:3.0:1788592686.907433:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437dad80 x1875475225954944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592686.907463:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225954944:0@lo:13: 00000001:00100000:1.0:1788592686.911289:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000001:00080000:1.0:1788592686.911304:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788592686.911314:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788592687.032267:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788592687.936622:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000001:00100000:0.0:1788592687.942345:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00010000:00010000:3.0:1788592688.061624:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592688.566363:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592688.566409:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592688.566443:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592688.566465:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592688.566489:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592688.566522:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130240 00000100:00100000:2.0:1788592688.566535:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130240 00000100:00100000:2.0:1788592688.566701:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130112 00000100:00100000:2.0:1788592688.566717:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130112 00000100:00100000:2.0:1788592688.566768:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:2.0:1788592688.566782:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209130240:12345-192.168.203.47@tcp:400: 00000100:00100000:2.0:1788592688.566874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209130240:12345-192.168.203.47@tcp:400: Request processed in 97us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.566882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:2.0:1788592688.566912:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:2.0:1788592688.566920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209130112:12345-192.168.203.47@tcp:400: 00000100:00100000:2.0:1788592688.566947:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209130112:12345-192.168.203.47@tcp:400: Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.566953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:2.0:1788592688.566980:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130496 00000100:00100000:2.0:1788592688.566998:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130496 00000100:00100000:2.0:1788592688.567028:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130368 00000100:00100000:2.0:1788592688.567031:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130368 00000100:00100000:2.0:1788592688.567053:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:2.0:1788592688.567061:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209130496:12345-192.168.203.47@tcp:400: 00000100:00100000:2.0:1788592688.567122:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209130496:12345-192.168.203.47@tcp:400: Request processed in 62us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.567128:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:2.0:1788592688.567140:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592688.567146:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209130368:12345-192.168.203.47@tcp:400: 00000100:00100000:2.0:1788592688.567169:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209130368:12345-192.168.203.47@tcp:400: Request processed in 23us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.567175:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00080000:2.0:1788592688.567195:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592688.567200:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592688.567203:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592688.567204:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592688.567649:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209129984 00000100:00100000:3.0:1788592688.567659:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209129984 00000100:00100000:3.0:1788592688.567727:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 197 00000100:00100000:3.0:1788592688.567739:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:2396:x1875475209129984:12345-192.168.203.47@tcp:400: 00000100:00100000:3.0:1788592688.567816:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:2396:x1875475209129984:12345-192.168.203.47@tcp:400: Request processed in 79us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592688.567824:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 197 00000001:02000400:0.0:1788592688.667820:0:10177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788592688.952701:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225955200:0@lo:41: 00000100:00100000:0.0:1788592688.952806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592688.952973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955200 00000100:00100000:3.0:1788592688.952983:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955200 00000100:00100000:3.0:1788592688.953050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592688.953061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225955200:12345-0@lo:41: 00000004:00000024:3.0:1788592688.953136:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788592688.953190:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225955200:12345-0@lo:41: Request processed in 131us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592688.953197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592688.953301:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225955200:0@lo:41: 00000100:00100000:2.0:1788592688.953875:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592688.953896:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225955328:0@lo:41: 00000100:00100000:2.0:1788592688.954030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592688.954988:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955328 00000100:00100000:3.0:1788592688.955001:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955328 00000100:00100000:3.0:1788592688.955056:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788592688.955092:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225955328:12345-0@lo:41: 00000004:00000024:3.0:1788592688.955131:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592688.955211:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225955328:12345-0@lo:41: Request processed in 147us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592688.955220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788592688.955583:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225955328:0@lo:41: 00000001:00100000:2.0:1788592688.965486:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00010000:00010000:1.0:1788592689.086489:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592690.105463:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592691.001571:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225955456:0@lo:13: 00000100:00100000:3.0:1788592691.001638:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.001744:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955456 00000100:00100000:2.0:1788592691.001752:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955456 00000100:00100000:2.0:1788592691.001810:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592691.001820:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225955456:12345-0@lo:13: 00002000:00000024:2.0:1788592691.001846:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592691.001906:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225955456:12345-0@lo:13: Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.001913:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788592691.001954:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875ab8380 x1875475225955456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592691.001965:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788592691.001985:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225955456:0@lo:13: 00000100:00080000:3.0:1788592691.002038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592691.002462:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225955712:0@lo:400: 00000100:00100000:2.0:1788592691.002496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.002520:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225956224:0@lo:400: 00000100:00100000:2.0:1788592691.002541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.002563:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225956736:0@lo:400: 00000100:00100000:2.0:1788592691.002583:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.002606:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788592691.002612:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225955840:0@lo:400: 00000100:00100000:2.0:1788592691.002633:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.002655:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225956352:0@lo:400: 00000100:00100000:2.0:1788592691.002674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.002689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225956864:0@lo:400: 00000100:00100000:2.0:1788592691.002706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.002727:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955712 00000100:00100000:2.0:1788592691.002731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955712 00000100:00100000:2.0:1788592691.002754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956224 00000100:00100000:2.0:1788592691.002757:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956224 00000100:00100000:2.0:1788592691.002775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956736 00000100:00100000:2.0:1788592691.002778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956736 00000100:00100000:2.0:1788592691.002803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956352 00000100:00100000:2.0:1788592691.002806:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956352 00000100:00100000:2.0:1788592691.002831:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956864 00000100:00100000:2.0:1788592691.002834:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956864 00000100:00100000:2.0:1788592691.002849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592691.002855:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225955712:12345-0@lo:400: 00000100:00100000:2.0:1788592691.002895:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225955712:12345-0@lo:400: Request processed in 39us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.002901:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592691.002914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592691.002921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225956224:12345-0@lo:400: 00000100:00100000:2.0:1788592691.002946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225956224:12345-0@lo:400: Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.002952:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592691.002964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788592691.002969:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225956736:12345-0@lo:400: 00000100:00100000:2.0:1788592691.002995:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225956736:12345-0@lo:400: Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.003001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788592691.003010:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788592691.003016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225956352:12345-0@lo:400: 00000100:00100000:2.0:1788592691.003038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225956352:12345-0@lo:400: Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.003043:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788592691.003053:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788592691.003058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225956864:12345-0@lo:400: 00000100:00100000:2.0:1788592691.003113:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225956864:12345-0@lo:400: Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.003125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592691.003340:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225955584:0@lo:400: 00000100:00100000:0.0:1788592691.003374:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592691.003405:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225956096:0@lo:400: 00000100:00100000:0.0:1788592691.003427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592691.003438:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225956608:0@lo:400: 00000100:00100000:0.0:1788592691.003458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592691.003479:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788592691.003485:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225955968:0@lo:400: 00000100:00100000:0.0:1788592691.003504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592691.003521:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225956480:0@lo:400: 00000100:00100000:0.0:1788592691.003540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592691.003556:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225956992:0@lo:400: 00000100:00100000:0.0:1788592691.003575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592691.003601:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956608 00000100:00100000:0.0:1788592691.003605:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956608 00000100:00100000:0.0:1788592691.003637:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956480 00000100:00100000:0.0:1788592691.003640:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956480 00000100:00100000:0.0:1788592691.003659:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956992 00000100:00100000:0.0:1788592691.003669:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956992 00000100:00100000:0.0:1788592691.003687:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592691.003693:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225956608:12345-0@lo:400: 00000100:00100000:0.0:1788592691.003731:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225956608:12345-0@lo:400: Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592691.003738:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592691.003750:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788592691.003756:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225956480:12345-0@lo:400: 00000100:00100000:0.0:1788592691.003781:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225956480:12345-0@lo:400: Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592691.003786:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788592691.003796:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592691.003801:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225956992:12345-0@lo:400: 00000100:00100000:0.0:1788592691.003826:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225956992:12345-0@lo:400: Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592691.003831:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592691.003848:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955840 00000100:00100000:0.0:1788592691.003852:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955840 00000100:00100000:0.0:1788592691.003872:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955968 00000100:00100000:0.0:1788592691.003875:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955968 00000100:00100000:0.0:1788592691.003888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592691.003893:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225955840:12345-0@lo:400: 00000100:00100000:0.0:1788592691.003923:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225955840:12345-0@lo:400: Request processed in 30us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592691.003929:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592691.003940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788592691.003945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225955968:12345-0@lo:400: 00000100:00100000:0.0:1788592691.003981:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225955968:12345-0@lo:400: Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592691.003987:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788592691.004038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225955968:0@lo:400: 00010000:00080000:0.0:1788592691.004052:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875a3c700 x1875475225956480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592691.004062:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225956480:0@lo:400: 00010000:00080000:0.0:1788592691.004102:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f514380 x1875475225956992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592691.004110:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788592691.004124:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225956992:0@lo:400: 00010000:00080000:0.0:1788592691.004150:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875a3ca80 x1875475225956608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592691.004157:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225956608:0@lo:400: 00000100:00100000:3.0:1788592691.004238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225955584 00000100:00100000:3.0:1788592691.004243:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225955584 00000100:00100000:3.0:1788592691.004280:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788592691.004287:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225955584:12345-0@lo:400: 00000100:00100000:3.0:1788592691.004335:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225955584:12345-0@lo:400: Request processed in 49us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592691.004343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788592691.004462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225956096 00000100:00100000:2.0:1788592691.004466:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225956096 00000100:00100000:2.0:1788592691.004481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592691.004487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225956096:12345-0@lo:400: 00000100:00100000:2.0:1788592691.004517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225956096:12345-0@lo:400: Request processed in 30us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.004523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788592691.004554:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592691.004558:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592691.004561:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592691.004563:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592691.004588:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225955840:0@lo:400: 00010000:00080000:2.0:1788592691.004600:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741ddb480 x1875475225956352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592691.004608:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225956352:0@lo:400: 00010000:00080000:2.0:1788592691.004619:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875a3fb80 x1875475225956864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592691.004626:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225956864:0@lo:400: 00000100:00100000:2.0:1788592691.004639:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225955712:0@lo:400: 00000100:00100000:2.0:1788592691.004650:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225956224:0@lo:400: 00000100:00100000:2.0:1788592691.004660:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225956736:0@lo:400: 00000100:00100000:0.0:1788592691.006465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225955584:0@lo:400: 00000100:00100000:0.0:1788592691.006486:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225956096:0@lo:400: 00010000:00010000:0.0:1788592691.129460:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592691.514697:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225957120:0@lo:13: 00000100:00100000:0.0:1788592691.514769:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592691.515050:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225957120 00000100:00100000:2.0:1788592691.515058:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225957120 00000100:00100000:2.0:1788592691.515159:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592691.515168:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225957120:12345-0@lo:13: 00002000:00000024:2.0:1788592691.515190:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592691.515588:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225957120:12345-0@lo:13: Request processed in 420us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592691.515596:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788592691.515693:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f517800 x1875475225957120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592691.515712:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225957120:0@lo:13: 00000100:00100000:3.0:1788592692.025613:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225957248:0@lo:13: 00000100:00100000:3.0:1788592692.025714:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592692.026170:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225957248 00000100:00100000:3.0:1788592692.026177:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225957248 00000100:00100000:3.0:1788592692.026327:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788592692.026337:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225957248:12345-0@lo:13: 00002000:00000024:3.0:1788592692.026365:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592692.026419:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225957248:12345-0@lo:13: Request processed in 83us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592692.026426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788592692.026526:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437dad80 x1875475225957248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592692.026544:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225957248:0@lo:13: 00000100:00100000:0.0:1788592692.030639:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225957376:0@lo:13: 00000100:00100000:0.0:1788592692.030894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592692.031182:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225957376 00000100:00100000:1.0:1788592692.031190:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225957376 00000100:00100000:1.0:1788592692.031431:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592692.031441:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225957376:12345-0@lo:13: 00002000:00000024:1.0:1788592692.031464:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592692.031520:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225957376:12345-0@lo:13: Request processed in 80us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592692.031527:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788592692.031641:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f515f80 x1875475225957376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592692.031660:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225957376:0@lo:13: 00010000:00010000:1.0:1788592692.153653:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788592692.201385:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee14eeb90 20000000:00000080:3.0:1788592692.201535:0:10324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92186f513c00 uarg=0000000000000000 20000000:01000000:3.0:1788592692.201601:0:10324:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788592692.201604:0:10324:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788592692.201607:0:10324:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788592692.201613:0:10324:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788592692.201619:0:10324:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788592692.201677:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788592692.201679:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788592692.202695:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788592692.203276:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788592692.203321:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788592692.203337:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788592692.203348:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788592692.203350:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788592692.203974:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788592692.205353:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788592692.205526:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788592692.205548:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788592692.205579:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788592692.205582:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788592692.208361:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788592692.209149:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788592692.209177:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788592692.209204:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788592692.209219:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788592692.209221:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788592692.209925:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788592692.210288:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788592692.210330:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788592692.210346:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788592692.210357:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788592692.210360:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788592692.211004:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788592692.211508:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788592692.211540:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788592692.211557:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:0.0:1788592692.211571:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788592692.211592:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211612:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211620:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211627:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211646:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211654:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211661:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211668:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211677:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211683:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4cba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211693:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211701:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.211709:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.212539:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.212570:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 9 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592692.212586:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957504:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592692.213384:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.213397:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.213407:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957632:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592692.213459:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4cba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.213467:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4cba expref: 23 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.213476:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957760:0@lo:104: 00000100:00100000:1.0:1788592692.213517:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.213555:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.213563:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 23 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.213586:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957888:0@lo:104: 00000100:00100000:1.0:1788592692.213609:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.213647:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.213655:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 23 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.213663:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958016:0@lo:104: 00000100:00100000:1.0:1788592692.213683:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.213701:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.213709:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 23 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.213727:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958144:0@lo:104: 00000100:00100000:1.0:1788592692.213768:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.213795:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.213804:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 23 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.213812:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958272:0@lo:104: 00000100:00100000:2.0:1788592692.213920:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788592692.213934:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225957760 00000100:00100000:2.0:1788592692.213940:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225957760 00000100:00100000:2.0:1788592692.213977:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225957888 00000100:00100000:2.0:1788592692.213980:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225957888 00000100:00100000:2.0:1788592692.213990:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958016 00000100:00100000:2.0:1788592692.213991:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958016 00000100:00100000:2.0:1788592692.213999:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958144 00000100:00100000:2.0:1788592692.214001:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958144 00000100:00100000:2.0:1788592692.214013:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592692.214021:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:10324:x1875475225957760:12345-0@lo:104: 00010000:00010000:2.0:1788592692.214035:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214110:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592692.214116:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:10324:x1875475225957760:12345-0@lo:104: Request processed in 96us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.214123:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592692.214139:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592692.214144:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10324:x1875475225957888:12345-0@lo:104: 00010000:00010000:2.0:1788592692.214152:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214210:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592692.214216:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10324:x1875475225957888:12345-0@lo:104: Request processed in 72us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.214222:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592692.214235:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592692.214241:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10324:x1875475225958016:12345-0@lo:104: 00010000:00010000:2.0:1788592692.214248:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214281:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788592692.214286:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10324:x1875475225958016:12345-0@lo:104: Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.214292:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592692.214315:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592692.214321:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:10324:x1875475225958144:12345-0@lo:104: 00010000:00010000:2.0:1788592692.214329:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214356:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788592692.214360:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:10324:x1875475225958144:12345-0@lo:104: Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.214366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788592692.214406:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788592692.214413:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214431:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592692.214435:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214443:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592692.214450:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592692.214455:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592692.214487:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214494:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592692.214513:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214520:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214533:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788592692.214536:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214541:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592692.214543:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214560:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592692.214566:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592692.214571:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592692.214585:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214591:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592692.214596:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214603:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742838000/0xbd314a3362db4c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c97 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214612:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592692.214615:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214620:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592692.214623:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214629:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592692.214636:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592692.214646:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592692.214657:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214663:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592692.214679:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214685:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214694:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592692.214696:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214702:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592692.214705:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214712:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592692.214717:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592692.214722:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592692.214734:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214739:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592692.214751:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214757:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db4c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.214766:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592692.214768:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592692.214770:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592692.214777:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592692.214782:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592692.214800:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225958400:0@lo:103: 00000100:00100000:2.0:1788592692.214846:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.214871:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592692.214876:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225958528:0@lo:103: 00000100:00100000:2.0:1788592692.214894:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.214919:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225958656:0@lo:103: 00000100:00100000:2.0:1788592692.214937:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.214953:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592692.214958:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225958784:0@lo:103: 00000100:00100000:2.0:1788592692.214975:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.214998:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958400 00000100:00100000:2.0:1788592692.215003:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958400 00010000:00010000:2.0:1788592692.215023:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4cba expref: 24 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.215038:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958528 00000100:00100000:2.0:1788592692.215041:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958528 00010000:00010000:2.0:1788592692.215049:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 25 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.215095:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958656 00000100:00100000:2.0:1788592692.215099:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958656 00010000:00010000:2.0:1788592692.215111:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 26 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.215121:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958784 00000100:00100000:2.0:1788592692.215123:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958784 00010000:00010000:2.0:1788592692.215132:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 27 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.215144:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592692.215151:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+27:3641:x1875475225958400:12345-0@lo:103: 00010000:00010000:2.0:1788592692.215162:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.215167:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4cba expref: 27 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215176:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4cba expref: 27 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215193:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.215224:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+27:3641:x1875475225958400:12345-0@lo:103: Request processed in 73us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.215230:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592692.215268:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592692.215274:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+26:3641:x1875475225958528:12345-0@lo:103: 00010000:00010000:2.0:1788592692.215281:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.215285:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 26 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215315:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 26 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215324:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.215348:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+26:3641:x1875475225958528:12345-0@lo:103: Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.215355:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592692.215367:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592692.215373:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+25:3639:x1875475225958656:12345-0@lo:103: 00010000:00010000:2.0:1788592692.215380:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.215384:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 25 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215392:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 25 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215401:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.215426:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+25:3639:x1875475225958656:12345-0@lo:103: Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.215432:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592692.215443:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592692.215449:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225958784:12345-0@lo:103: 00010000:00010000:2.0:1788592692.215456:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.215460:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 24 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215468:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 24 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.215484:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.215507:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225958784:12345-0@lo:103: Request processed in 58us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.215513:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592692.215554:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225958784:0@lo:103: 00000100:00100000:2.0:1788592692.215565:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225958656:0@lo:103: 00000100:00100000:2.0:1788592692.215588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225958528:0@lo:103: 00000100:00100000:2.0:1788592692.215595:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225958400:0@lo:103: 00000100:00100000:1.0:1788592692.216231:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.216279:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.216315:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 23 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.216327:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958912:0@lo:104: 00000100:00100000:1.0:1788592692.216357:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.216425:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.216445:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 23 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.216454:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225959040:0@lo:104: 00000100:00100000:1.0:1788592692.216475:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592692.218023:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.218038:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 23 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.218051:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225959168:0@lo:104: 00000100:00100000:1.0:1788592692.218116:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592692.218319:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958272 00000100:00100000:3.0:1788592692.218326:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958272 00000100:00100000:3.0:1788592692.218542:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225958912 00000100:00100000:3.0:1788592692.218547:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225958912 00000100:00100000:3.0:1788592692.218563:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959040 00000100:00100000:3.0:1788592692.218565:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959040 00000100:00100000:3.0:1788592692.218577:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592692.218586:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10324:x1875475225958272:12345-0@lo:104: 00010000:00010000:3.0:1788592692.218600:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592692.218699:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592692.218706:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10324:x1875475225958272:12345-0@lo:104: Request processed in 121us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592692.218713:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592692.218740:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788592692.218746:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10324:x1875475225958912:12345-0@lo:104: 00010000:00010000:3.0:1788592692.218754:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.222326:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.222344:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 23 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.222360:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225959296:0@lo:104: 00000100:00100000:1.0:1788592692.222429:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592692.222443:0:10324:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d58cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788592692.222468:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841495800/0xbd314a3362db4cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4cba expref: 23 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.222484:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957760:0@lo:104: 00010000:00010000:1.0:1788592692.222495:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b81a00/0xbd314a3362db4c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4c90 expref: 22 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.222503:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957888:0@lo:104: 00010000:00010000:1.0:1788592692.222513:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80e00/0xbd314a3362db4c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4c74 expref: 21 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.222520:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958016:0@lo:104: 00010000:00010000:1.0:1788592692.222528:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742838400/0xbd314a3362db4c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4c4a expref: 20 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.222536:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958144:0@lo:104: 00000100:00100000:1.0:1788592692.222544:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958272:0@lo:104: 00000100:00100000:1.0:1788592692.222552:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225958912:0@lo:104: 00000100:00100000:2.0:1788592692.222691:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788592692.222702:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788592692.222836:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592692.222844:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.222853:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592692.222858:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.222868:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592692.222876:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592692.222883:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592692.222925:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.222932:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592692.222949:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.222956:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840031400/0xbd314a3362db4c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c35 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.222982:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592692.222985:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.222991:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80a00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592692.222994:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.223000:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592692.223006:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592692.223012:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592692.223028:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.223034:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592692.223040:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.223046:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c27 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.223055:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592692.223056:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592692.223058:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592692.223209:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225959552:0@lo:103: 00000100:00100000:2.0:1788592692.223251:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.223289:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592692.223304:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225959424:0@lo:103: 00000100:00100000:2.0:1788592692.223324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.223352:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959552 00000100:00100000:2.0:1788592692.223358:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959552 00010000:00010000:2.0:1788592692.223386:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 20 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.223410:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959424 00000100:00100000:2.0:1788592692.223412:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959424 00010000:00010000:2.0:1788592692.223423:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 21 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.223437:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592692.223454:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3642:x1875475225959552:12345-0@lo:103: 00010000:00010000:2.0:1788592692.223469:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.223475:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 21 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.223485:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 21 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.223499:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205ec00/0xbd314a3362db4c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4c20 expref: 21 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.223512:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.223544:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3642:x1875475225959552:12345-0@lo:103: Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.223551:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592692.223568:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592692.223573:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3642:x1875475225959424:12345-0@lo:103: 00010000:00010000:2.0:1788592692.223582:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.223585:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 19 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.223592:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 19 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.223601:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205e800/0xbd314a3362db4c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4c2e expref: 19 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.223609:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.223630:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3642:x1875475225959424:12345-0@lo:103: Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.223645:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592692.223691:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225959424:0@lo:103: 00000100:00100000:2.0:1788592692.223702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225959552:0@lo:103: 00000100:00100000:1.0:1788592692.224134:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959168 00000100:00100000:1.0:1788592692.224139:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959168 00000100:00100000:1.0:1788592692.224167:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788592692.224174:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959296 00000100:00100000:1.0:1788592692.224177:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959296 00000100:00100000:0.0:1788592692.224348:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592692.224365:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:10324:x1875475225959040:12345-0@lo:104: 00010000:00010000:0.0:1788592692.224377:0:10330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224448:0:10330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592692.224454:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:10324:x1875475225959040:12345-0@lo:104: Request processed in 92us (7978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.224461:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592692.224475:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788592692.224481:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10324:x1875475225959168:12345-0@lo:104: 00010000:00010000:0.0:1788592692.224489:0:10330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224519:0:10330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788592692.224523:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10324:x1875475225959168:12345-0@lo:104: Request processed in 44us (6408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.224529:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788592692.224541:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788592692.224546:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10324:x1875475225959296:12345-0@lo:104: 00010000:00010000:0.0:1788592692.224554:0:10330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224584:0:10330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788592692.224589:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10324:x1875475225959296:12345-0@lo:104: Request processed in 43us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.224596:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788592692.224609:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788592692.224619:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224626:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030c00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592692.224631:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224639:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592692.224646:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592692.224651:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592692.224684:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224690:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592692.224706:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224713:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4c12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4c19 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224728:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592692.224731:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224736:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839a00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592692.224738:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224755:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592692.224762:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592692.224767:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592692.224782:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224787:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592692.224793:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224799:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742839a00/0xbd314a3362db4bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bda expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224808:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592692.224811:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224816:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592692.224819:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224902:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592692.224910:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592692.224922:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592692.224936:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224942:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592692.224951:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224957:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742839400/0xbd314a3362db4ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bb0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592692.224969:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592692.224971:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592692.224973:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592692.225175:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225959808:0@lo:103: 00000100:00100000:2.0:1788592692.225289:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.225334:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592692.225340:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225959680:0@lo:103: 00000100:00100000:2.0:1788592692.225374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592692.225397:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592692.225403:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592692.225413:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959808 00000100:00100000:2.0:1788592692.225417:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959808 00010000:00010000:2.0:1788592692.225438:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 18 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.225459:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959680 00000100:00100000:2.0:1788592692.225461:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959680 00010000:00010000:2.0:1788592692.225472:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 19 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.225484:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592692.225490:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3640:x1875475225959808:12345-0@lo:103: 00010000:00010000:2.0:1788592692.225500:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.225506:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 19 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.225515:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 19 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.225538:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.225568:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3640:x1875475225959808:12345-0@lo:103: Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.225575:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592692.225589:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592692.225594:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3640:x1875475225959680:12345-0@lo:103: 00010000:00010000:2.0:1788592692.225603:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.225608:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 18 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.225617:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 18 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.225626:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.225645:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:3640:x1875475225959680:12345-0@lo:103: Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.225651:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592692.225706:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225959936:0@lo:103: 00000100:00100000:2.0:1788592692.225729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.225765:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225959680:0@lo:103: 00000100:00100000:2.0:1788592692.225772:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225959808:0@lo:103: 00000100:00100000:2.0:1788592692.225793:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225959936 00000100:00100000:2.0:1788592692.225796:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225959936 00010000:00010000:2.0:1788592692.225807:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 18 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592692.225823:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788592692.225958:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f200/0xbd314a3362db4c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4c12 expref: 18 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.225969:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225959040:0@lo:104: 00010000:00010000:1.0:1788592692.225988:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840031600/0xbd314a3362db4bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4bd3 expref: 17 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.225999:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225959168:0@lo:104: 00000100:00100000:1.0:1788592692.226008:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225959296:0@lo:104: 00000100:00100000:2.0:1788592692.226450:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:3641:x1875475225959936:12345-0@lo:103: 00010000:00010000:2.0:1788592692.226460:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592692.226466:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 16 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.226475:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 16 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.226487:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205e200/0xbd314a3362db4bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4ba9 expref: 16 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.226498:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592692.226546:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:3641:x1875475225959936:12345-0@lo:103: Request processed in 98us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592692.226590:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225959936:0@lo:103: 00010000:00010000:3.0:1788592692.227381:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788592692.227392:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:10324:x1875475225958912:12345-0@lo:104: Request processed in 8645us (11033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592692.227402:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788592692.227613:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:1.0:1788592692.228098:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592692.228139:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957504:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592692.228149:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1875475225957632:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592692.228211:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592692.228555:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788592692.228565:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788592692.228804:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130624 00000100:00100000:1.0:1788592692.228811:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130624 00010000:00010000:1.0:1788592692.229494:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.229524:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:1.0:1788592692.229533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2396:x1875475209130624:12345-192.168.203.47@tcp:103: 00010000:00010000:1.0:1788592692.229548:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592692.229554:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.229567:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.229587:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80200/0xbd314a3362db4cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c39 expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.229606:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592692.229671:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+9:2396:x1875475209130624:12345-192.168.203.47@tcp:103: Request processed in 139us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592692.229680:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:2.0:1788592692.230183:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788592692.244218:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592692.244291:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130752 00000100:00100000:1.0:1788592692.244310:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130752 00010000:00010000:1.0:1788592692.244346:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592692.244387:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:1.0:1788592692.244406:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+9:2395:x1875475209130752:12345-192.168.203.47@tcp:103: 00010000:00010000:1.0:1788592692.244422:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592692.244427:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244440:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244459:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841494800/0xbd314a3362db4ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c32 expref: 9 pid: 6507 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244478:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244488:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244503:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244523:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244530:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244537:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244543:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841495e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592692.244547:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244555:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244582:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592692.244594:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592692.244655:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+8:2395:x1875475209130752:12345-192.168.203.47@tcp:103: Request processed in 259us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592692.244663:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 34 00010000:00010000:2.0:1788592692.244806:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.244816:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592692.244821:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841495e00/0xbd314a3362db4d15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592693.176230:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592693.561180:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592693.561279:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209130880 00000100:00100000:3.0:1788592693.561311:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209130880 00000100:00100000:3.0:1788592693.561405:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 199 00000100:00100000:3.0:1788592693.561416:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+8:6162:x1875475209130880:12345-192.168.203.47@tcp:101: 00010000:00010000:3.0:1788592693.561435:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592693.561455:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205ea00/0xbd314a3362db4d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ca9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592693.561481:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205ea00/0xbd314a3362db4d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ca9 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592693.561492:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205ea00/0xbd314a3362db4d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ca9 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592693.561500:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ea00, rc 0) 00000100:00100000:3.0:1788592693.561566:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209130880:12345-192.168.203.47@tcp:101: Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592693.561573:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 199 00000100:00100000:3.0:1788592693.565541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592693.565650:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131008 00000100:00100000:0.0:1788592693.565661:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131008 00000100:00100000:0.0:1788592693.565718:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:0.0:1788592693.565737:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209131008:12345-192.168.203.47@tcp:501: 00000100:00100000:0.0:1788592693.565908:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209131008:12345-192.168.203.47@tcp:501: Request processed in 181us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592693.565925:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:0.0:1788592693.568258:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592693.568475:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131136 00000100:00100000:3.0:1788592693.568484:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131136 00000100:00100000:3.0:1788592693.568535:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 201 00000100:00100000:3.0:1788592693.568549:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209131136:12345-192.168.203.47@tcp:503: 00000100:00100000:3.0:1788592693.568877:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209131136:12345-192.168.203.47@tcp:503: Request processed in 329us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592693.568886:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 201 00000100:00100000:1.0:1788592693.577533:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592693.577628:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131264 00000100:00100000:2.0:1788592693.577638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131264 00000100:00100000:2.0:1788592693.577686:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 202 00000100:00100000:2.0:1788592693.577696:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+9:6646:x1875475209131264:12345-192.168.203.47@tcp:502: 00000100:00100000:2.0:1788592693.577925:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+9:6646:x1875475209131264:12345-192.168.203.47@tcp:502: Request processed in 230us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592693.577934:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 202 00000100:00100000:1.0:1788592693.581944:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592693.582241:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131392 00000100:00100000:0.0:1788592693.582251:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131392 00000100:00100000:0.0:1788592693.582322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 203 00000100:00100000:0.0:1788592693.582345:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+9:6646:x1875475209131392:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592693.582493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+9:6646:x1875475209131392:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 149us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592693.582506:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 203 00000100:00100000:0.0:1788592693.593405:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592693.593498:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131520 00000100:00100000:3.0:1788592693.593508:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131520 00000100:00100000:3.0:1788592693.593562:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 204 00000100:00100000:3.0:1788592693.593586:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209131520:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592693.593602:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592693.593619:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205e400/0xbd314a3362db4d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2cb0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592693.593644:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205e400/0xbd314a3362db4d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb0 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592693.593656:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205e400/0xbd314a3362db4d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb0 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592693.593665:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e400, rc 0) 00000100:00100000:3.0:1788592693.593727:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209131520:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 143us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592693.593734:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 204 00000100:00100000:1.0:1788592693.597499:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592693.598482:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131648 00000100:00100000:2.0:1788592693.598494:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131648 00000100:00100000:2.0:1788592693.598605:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 205 00000100:00100000:2.0:1788592693.598615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209131648:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592693.598844:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209131648:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 230us (1353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592693.598920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 205 00000100:00100000:1.0:1788592693.690220:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592693.690272:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592693.690323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131776 00000100:00100000:2.0:1788592693.690333:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131776 00000100:00100000:2.0:1788592693.690421:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209131904 00000100:00100000:2.0:1788592693.690424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209131904 00000100:00080000:0.0:1788592693.690451:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592693.690453:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00080000:0.0:1788592693.690459:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592693.690468:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209131776:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592693.690497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:0.0:1788592693.690510:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209131904:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592693.690546:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209131776:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592693.690551:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209131904:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592693.690561:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:2.0:1788592693.691682:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592693.691993:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132160 00000100:00100000:3.0:1788592693.692003:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132160 00000100:00100000:3.0:1788592693.692089:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:3.0:1788592693.692100:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209132160:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592693.692177:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592693.692201:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132032 00000100:00100000:2.0:1788592693.692205:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132032 00000100:00100000:2.0:1788592693.692235:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:2.0:1788592693.692243:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209132032:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592693.692281:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209132032:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592693.692350:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209132160:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 252us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592693.692359:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:0.0:1788592693.692435:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:2.0:1788592693.692496:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00080000:1.0:1788592693.692956:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592693.692969:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1788592694.008522:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788592694.008530:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92174243f000 from 48 10000000:01000000:2.0:1788592694.008535:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592694.008585:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.008596:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.008606:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.008629:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960064:0@lo:101: 00000100:00100000:2.0:1788592694.008695:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.008808:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.009035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960064 00000100:00100000:0.0:1788592694.009043:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960064 00000100:00100000:0.0:1788592694.009162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788592694.009173:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+15:6509:x1875475225960064:12345-0@lo:101: 00010000:00010000:0.0:1788592694.009185:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592694.009198:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841495000/0xbd314a3362db4d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.009221:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495000/0xbd314a3362db4d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d2a expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.009232:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841495000/0xbd314a3362db4d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d2a expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.009242:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841495000, rc 0) 00000100:00100000:0.0:1788592694.009343:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225960064:12345-0@lo:101: Request processed in 171us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.009350:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788592694.009558:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960064:0@lo:101: 00010000:00010000:2.0:1788592694.009573:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.009583:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.009638:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960192:0@lo:501: 00000100:00100000:2.0:1788592694.009663:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.009735:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.009778:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960192 00000100:00100000:0.0:1788592694.009783:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960192 00000100:00100000:0.0:1788592694.009813:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788592694.009820:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225960192:12345-0@lo:501: 00000100:00100000:0.0:1788592694.009951:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225960192:12345-0@lo:501: Request processed in 132us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.009958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788592694.010277:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960192:0@lo:501: 00000100:00100000:1.0:1788592694.010321:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960320:0@lo:503: 00000100:00100000:1.0:1788592694.010365:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.010397:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.010411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960320 00000100:00100000:0.0:1788592694.010417:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960320 00000100:00100000:0.0:1788592694.010480:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788592694.010496:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225960320:12345-0@lo:503: 00000100:00100000:0.0:1788592694.010582:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225960320:12345-0@lo:503: Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.010588:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788592694.010632:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960320:0@lo:503: 00000100:00100000:2.0:1788592694.011213:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10343:1875475225960448:0@lo:502: 00000100:00100000:2.0:1788592694.011252:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.011386:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.012756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960448 00000100:00100000:3.0:1788592694.012777:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960448 00000100:00100000:3.0:1788592694.012838:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788592694.012847:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10343:x1875475225960448:12345-0@lo:502: 00000100:00100000:3.0:1788592694.012998:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10343:x1875475225960448:12345-0@lo:502: Request processed in 152us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.013013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788592694.013221:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10343:1875475225960448:0@lo:502: 00000100:00100000:0.0:1788592694.013273:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10343:1875475225960576:0@lo:502: 00000100:00100000:0.0:1788592694.013322:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.013354:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.013450:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960576 00000100:00100000:3.0:1788592694.013455:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960576 00000100:00100000:3.0:1788592694.013486:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788592694.013502:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10343:x1875475225960576:12345-0@lo:502: 00000100:00100000:3.0:1788592694.013578:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:10343:x1875475225960576:12345-0@lo:502: Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.013585:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788592694.013717:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10343:1875475225960576:0@lo:502: 00000040:00080000:1.0:1788592694.013737:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788592694.014417:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788592694.014441:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788592694.014451:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.014461:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592694.014470:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788592694.014473:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788592694.014476:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788592694.014514:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.014522:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.014531:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592694.014545:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960704:0@lo:101: 00000100:00100000:3.0:1788592694.014588:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.014621:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592694.014720:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960704 00000100:00100000:2.0:1788592694.014726:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960704 00000100:00100000:2.0:1788592694.014763:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788592694.014787:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+16:6509:x1875475225960704:12345-0@lo:101: 00010000:00010000:2.0:1788592694.014796:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592694.014808:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81200/0xbd314a3362db4d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d38 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.014828:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81200/0xbd314a3362db4d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d38 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.014838:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81200/0xbd314a3362db4d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d38 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.014846:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81200, rc 0) 00000100:00100000:2.0:1788592694.014886:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225960704:12345-0@lo:101: Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592694.014893:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788592694.014961:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960704:0@lo:101: 00010000:00010000:1.0:1788592694.014974:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.014984:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592694.015031:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960832:0@lo:501: 00000100:00100000:1.0:1788592694.015055:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.015105:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592694.015233:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960832 00000100:00100000:2.0:1788592694.015237:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960832 00000100:00100000:2.0:1788592694.015254:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788592694.015260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225960832:12345-0@lo:501: 00000100:00100000:2.0:1788592694.015380:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225960832:12345-0@lo:501: Request processed in 120us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592694.015386:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788592694.015446:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960832:0@lo:501: 00000100:00100000:1.0:1788592694.015470:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960960:0@lo:503: 00000100:00100000:1.0:1788592694.015516:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.015538:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.015630:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225960960 00000100:00100000:0.0:1788592694.015634:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225960960 00000100:00100000:0.0:1788592694.015665:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788592694.015672:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225960960:12345-0@lo:503: 00000100:00100000:0.0:1788592694.015753:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225960960:12345-0@lo:503: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.015775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788592694.015943:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225960960:0@lo:503: 00000100:00100000:1.0:1788592694.016511:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10344:1875475225961088:0@lo:502: 00000100:00100000:1.0:1788592694.016562:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.016592:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.016694:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961088 00000100:00100000:0.0:1788592694.016699:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961088 00000100:00100000:0.0:1788592694.016730:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788592694.016737:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10344:x1875475225961088:12345-0@lo:502: 00000100:00100000:0.0:1788592694.016845:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10344:x1875475225961088:12345-0@lo:502: Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.016852:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788592694.017180:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10344:1875475225961088:0@lo:502: 00000020:01000000:1.0:1788592694.017201:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592694.017209:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592694.017211:0:10344:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788592694.017216:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788592694.017236:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10344:1875475225961216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.017266:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.017300:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.017351:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961216 00000100:00100000:3.0:1788592694.017355:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961216 00000100:00100000:3.0:1788592694.017389:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788592694.017396:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10344:x1875475225961216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.017470:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:10344:x1875475225961216:12345-0@lo:502:llog_process_th.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.017477:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788592694.017565:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10344:1875475225961216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592694.017582:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592694.017586:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592694.017587:0:10344:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788592694.017590:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788592694.017725:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788592694.017743:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788592694.017752:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.017777:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592694.017795:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788592694.017797:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9218764b9000 from 48 10000000:01000000:2.0:1788592694.017800:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592694.017825:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.017832:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.017841:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.017854:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.017883:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.017912:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.018112:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961344 00000100:00100000:1.0:1788592694.018116:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961344 00000100:00100000:1.0:1788592694.018135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788592694.018141:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+17:6509:x1875475225961344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592694.018149:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592694.018159:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839200/0xbd314a3362db4d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.018178:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839200/0xbd314a3362db4d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d46 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.018188:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839200/0xbd314a3362db4d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d46 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.018207:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839200, rc 0) 00000100:00100000:1.0:1788592694.018234:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225961344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.018239:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788592694.018443:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592694.018457:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.018466:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.018660:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.018684:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.018717:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.018759:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961472 00000100:00100000:1.0:1788592694.018763:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961472 00000100:00100000:1.0:1788592694.018807:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788592694.018813:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225961472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.019178:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225961472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.019186:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788592694.021269:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.021338:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.021407:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.021499:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.021639:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961600 00000100:00100000:3.0:1788592694.021645:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961600 00000100:00100000:3.0:1788592694.021725:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788592694.021734:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225961600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.021892:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225961600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.021900:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788592694.027304:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592694.027996:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10345:1875475225961728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592694.028099:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.028132:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.028497:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961728 00000100:00100000:3.0:1788592694.028505:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961728 00000100:00100000:3.0:1788592694.028552:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788592694.028561:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10345:x1875475225961728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.028673:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10345:x1875475225961728:12345-0@lo:502:llog_process_th.0 Request processed in 113us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.028681:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788592694.028792:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10345:1875475225961728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.028833:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10345:1875475225961856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.028867:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.028894:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.029054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961856 00000100:00100000:3.0:1788592694.029059:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961856 00000100:00100000:3.0:1788592694.029105:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788592694.029111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10345:x1875475225961856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.029173:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:10345:x1875475225961856:12345-0@lo:502:llog_process_th.0 Request processed in 61us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.029180:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788592694.029313:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10345:1875475225961856:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788592694.029333:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788592694.029728:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788592694.029748:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788592694.029757:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.029769:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592694.029789:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788592694.029792:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788592694.029794:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788592694.029820:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.029828:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.029837:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592694.029852:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.029885:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.029915:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592694.030010:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225961984 00000100:00100000:2.0:1788592694.030014:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225961984 00000100:00100000:2.0:1788592694.030053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788592694.030060:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+18:6509:x1875475225961984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592694.030087:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592694.030098:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81000/0xbd314a3362db4d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d54 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.030118:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81000/0xbd314a3362db4d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d54 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.030128:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81000/0xbd314a3362db4d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d54 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.030150:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81000, rc 0) 00000100:00100000:2.0:1788592694.030178:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225961984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592694.030184:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788592694.030437:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225961984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592694.030450:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.030465:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592694.030514:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.030539:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.030563:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.030575:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962112 00000100:00100000:3.0:1788592694.030579:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962112 00000100:00100000:3.0:1788592694.030618:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788592694.030624:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225962112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.030723:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225962112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.030730:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788592694.030888:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.030917:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.030952:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.030970:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.031011:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962240 00000100:00100000:3.0:1788592694.031015:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962240 00000100:00100000:3.0:1788592694.031168:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788592694.031175:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225962240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.031324:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225962240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.031331:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788592694.033057:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.033640:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10346:1875475225962368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.033700:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.033768:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592694.033865:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962368 00000100:00100000:2.0:1788592694.033872:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962368 00000100:00100000:2.0:1788592694.033914:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788592694.033922:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:10346:x1875475225962368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.034090:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:10346:x1875475225962368:12345-0@lo:502:llog_process_th.0 Request processed in 167us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592694.034097:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788592694.034394:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10346:1875475225962368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592694.034421:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592694.034429:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592694.034432:0:10346:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788592694.034436:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788592694.034458:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10346:1875475225962496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592694.034495:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.034559:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.034596:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962496 00000100:00100000:3.0:1788592694.034600:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962496 00000100:00100000:3.0:1788592694.034659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788592694.034666:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:10346:x1875475225962496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.034738:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:10346:x1875475225962496:12345-0@lo:502:llog_process_th.0 Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.034745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788592694.034814:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10346:1875475225962496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592694.034831:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592694.034835:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592694.034837:0:10346:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788592694.034840:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788592694.035025:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788592694.035053:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788592694.035063:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.035106:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592694.035116:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788592694.035125:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921875948800 from 48 10000000:01000000:1.0:1788592694.035139:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788592694.035163:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.035171:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.035180:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592694.035193:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.035220:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.035650:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592694.035687:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962624 00000100:00100000:2.0:1788592694.035692:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962624 00000100:00100000:0.0:1788592694.035731:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788592694.035739:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:6509:x1875475225962624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592694.035755:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592694.035767:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841495800/0xbd314a3362db4d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.035799:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495800/0xbd314a3362db4d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d62 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.035809:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841495800/0xbd314a3362db4d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d62 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.035817:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841495800, rc 0) 00000100:00100000:0.0:1788592694.035857:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225962624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.035864:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788592694.035981:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592694.035994:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.036003:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592694.036112:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.036940:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.036977:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.037025:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962752 00000100:00100000:0.0:1788592694.037031:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962752 00000100:00100000:0.0:1788592694.037084:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788592694.037092:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225962752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592694.037212:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225962752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.037219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788592694.037464:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.037500:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.037542:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.037569:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.037626:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225962880 00000100:00100000:3.0:1788592694.037630:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225962880 00000100:00100000:3.0:1788592694.037656:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788592694.037662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225962880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.037741:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225962880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.037747:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788592694.037877:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225962880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.038743:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10347:1875475225963008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.038801:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.038829:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.038868:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963008 00000100:00100000:0.0:1788592694.038874:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963008 00000100:00100000:0.0:1788592694.038909:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788592694.038916:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10347:x1875475225963008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592694.039017:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10347:x1875475225963008:12345-0@lo:502:llog_process_th.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.039032:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788592694.039322:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10347:1875475225963008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.039364:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10347:1875475225963136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.039395:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.039411:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.039454:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963136 00000100:00100000:3.0:1788592694.039458:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963136 00000100:00100000:3.0:1788592694.039488:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788592694.039494:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10347:x1875475225963136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.039566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:10347:x1875475225963136:12345-0@lo:502:llog_process_th.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.039573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788592694.039672:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10347:1875475225963136:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788592694.039690:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788592694.039877:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788592694.039897:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788592694.039906:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.039916:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592694.039936:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788592694.039939:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788592694.039941:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788592694.039964:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.039972:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.039980:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592694.039994:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.040019:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.040050:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.040332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963264 00000100:00100000:0.0:1788592694.040337:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963264 00000100:00100000:0.0:1788592694.040361:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788592694.040367:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225963264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592694.040375:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592694.040387:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841494800/0xbd314a3362db4d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d70 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.040408:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841494800/0xbd314a3362db4d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d70 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.040418:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841494800/0xbd314a3362db4d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d70 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.040426:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841494800, rc 0) 00000100:00100000:0.0:1788592694.040456:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225963264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.040462:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788592694.040565:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592694.040579:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592694.040588:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592694.040634:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.040655:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.040680:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.040692:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963392 00000100:00100000:3.0:1788592694.040694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963392 00000100:00100000:3.0:1788592694.040730:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788592694.040736:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225963392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.040836:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225963392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.040843:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788592694.040869:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.040891:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.040920:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592694.040932:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.040942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963520 00000100:00100000:3.0:1788592694.040944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963520 00000100:00100000:3.0:1788592694.040959:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788592694.040964:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225963520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.041025:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225963520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.041032:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788592694.041097:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.042751:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10348:1875475225963648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.042875:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.042947:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.042980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963648 00000100:00100000:3.0:1788592694.042986:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963648 00000100:00100000:3.0:1788592694.043166:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788592694.043175:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10348:x1875475225963648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.043322:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10348:x1875475225963648:12345-0@lo:502:llog_process_th.0 Request processed in 148us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.043330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788592694.043478:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10348:1875475225963648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788592694.043506:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592694.043515:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592694.043518:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788592694.043523:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788592694.043546:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10348:1875475225963776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.043578:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.043631:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.043657:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963776 00000100:00100000:3.0:1788592694.043666:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963776 00000100:00100000:3.0:1788592694.043718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788592694.043725:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10348:x1875475225963776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.043800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10348:x1875475225963776:12345-0@lo:502:llog_process_th.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.043807:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788592694.043861:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10348:1875475225963776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788592694.043878:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592694.043882:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592694.043883:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788592694.043893:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788592694.044249:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788592694.044267:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788592694.044277:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.044295:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592694.044305:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788592694.044307:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921846c66000 from 48 10000000:01000000:2.0:1788592694.044310:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592694.044335:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.044343:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.044351:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.044366:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.044394:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.044418:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.044506:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225963904 00000100:00100000:1.0:1788592694.044511:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225963904 00000100:00100000:1.0:1788592694.044533:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788592694.044540:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225963904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592694.044548:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592694.044561:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742838c00/0xbd314a3362db4d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d7e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.044581:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742838c00/0xbd314a3362db4d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d7e expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.044591:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742838c00/0xbd314a3362db4d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d7e expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.044611:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838c00, rc 0) 00000100:00100000:1.0:1788592694.044650:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225963904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.044657:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788592694.044718:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225963904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592694.044729:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.044738:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.044806:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.044830:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.044849:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.044932:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964032 00000100:00100000:1.0:1788592694.044936:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964032 00000100:00100000:1.0:1788592694.044954:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788592694.044959:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225964032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.045060:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225964032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.045093:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788592694.045196:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.045220:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.045251:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.045276:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.045318:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964160 00000100:00100000:1.0:1788592694.045322:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964160 00000100:00100000:1.0:1788592694.045339:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788592694.045345:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225964160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.045427:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225964160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.045433:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788592694.045498:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.045795:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10349:1875475225964288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.045829:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.045848:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.045934:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964288 00000100:00100000:1.0:1788592694.045939:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964288 00000100:00100000:1.0:1788592694.045958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788592694.045964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10349:x1875475225964288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.046054:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10349:x1875475225964288:12345-0@lo:502:llog_process_th.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.046060:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788592694.046213:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10349:1875475225964288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.046250:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10349:1875475225964416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592694.046293:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.046319:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.046356:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964416 00000100:00100000:1.0:1788592694.046360:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964416 00000100:00100000:1.0:1788592694.046378:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788592694.046384:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10349:x1875475225964416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.046448:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10349:x1875475225964416:12345-0@lo:502:llog_process_th.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.046455:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788592694.046575:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10349:1875475225964416:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788592694.046593:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788592694.046728:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788592694.046745:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592694.046753:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.046761:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592694.046769:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788592694.046772:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788592694.046774:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788592694.046863:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.046871:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.046879:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592694.046892:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.046923:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.046953:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592694.046992:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964544 00000100:00100000:2.0:1788592694.046996:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964544 00000100:00100000:2.0:1788592694.047025:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788592694.047031:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225964544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592694.047199:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592694.047383:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839600/0xbd314a3362db4d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d8c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.047406:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839600/0xbd314a3362db4d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d8c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.047416:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839600/0xbd314a3362db4d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d8c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.047425:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839600, rc 0) 00000100:00100000:1.0:1788592694.047492:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225964544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 460us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.047498:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788592694.047550:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592694.047562:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592694.047571:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592694.047617:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.047643:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.047706:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.047734:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964672 00000100:00100000:3.0:1788592694.047738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964672 00000100:00100000:3.0:1788592694.047847:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788592694.047855:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225964672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592694.047960:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225964672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.047966:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788592694.048018:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.048053:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592694.048114:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592694.048324:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.048373:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964800 00000100:00100000:0.0:1788592694.048378:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964800 00000100:00100000:0.0:1788592694.048401:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788592694.048407:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225964800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592694.048523:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225964800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.048529:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788592694.048633:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225964800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592694.049212:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10350:1875475225964928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592694.049254:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.049320:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592694.049355:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225964928 00000100:00100000:3.0:1788592694.049359:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225964928 00000100:00100000:3.0:1788592694.049424:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788592694.049431:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10350:x1875475225964928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592694.052746:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10350:x1875475225964928:12345-0@lo:502:llog_process_th.0 Request processed in 3303us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592694.052762:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788592694.052908:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10350:1875475225964928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592694.052950:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592694.052959:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592694.052961:0:10350:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788592694.052967:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788592694.053011:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10350:1875475225965056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592694.053098:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592694.053481:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592694.053560:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965056 00000100:00100000:0.0:1788592694.053567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965056 00000100:00100000:0.0:1788592694.053605:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788592694.053614:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10350:x1875475225965056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592694.053731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10350:x1875475225965056:12345-0@lo:502:llog_process_th.0 Request processed in 119us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.053739:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788592694.053866:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10350:1875475225965056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592694.053889:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592694.053893:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592694.053895:0:10350:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788592694.053899:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788592694.054058:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788592694.054101:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788592694.054110:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.054121:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592694.054138:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788592694.054140:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff921850ee4d40 from 1 10000000:01000000:0.0:1788592694.054143:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788592694.054168:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.054177:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.054187:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592694.054213:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225965184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592694.054240:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.054257:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.054370:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965184 00000100:00100000:1.0:1788592694.054375:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965184 00000100:00100000:1.0:1788592694.054400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788592694.054406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225965184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592694.054415:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592694.054426:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742838e00/0xbd314a3362db4da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4d9a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.054445:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742838e00/0xbd314a3362db4da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4d9a expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.054455:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742838e00/0xbd314a3362db4da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4d9a expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592694.054463:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838e00, rc 0) 00000100:00100000:1.0:1788592694.054490:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225965184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.054496:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788592694.054608:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225965184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592694.054621:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.054630:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592694.054672:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225965312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592694.054695:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.054722:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592694.054756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965312 00000100:00100000:1.0:1788592694.054760:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965312 00000100:00100000:1.0:1788592694.054776:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788592694.054791:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225965312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592694.054854:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225965312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (158us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592694.054861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788592694.054962:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225965312:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788592694.054982:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788592694.054987:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592694.054995:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592694.072456:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225965440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592694.072527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.072621:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225965568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592694.072666:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592694.072704:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965440 00000100:00100000:0.0:1788592694.072712:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965440 00000100:00100000:0.0:1788592694.072743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965568 00000100:00100000:0.0:1788592694.072745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965568 00000100:00100000:0.0:1788592694.072758:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788592694.072765:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225965440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788592694.072797:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788592694.072845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225965440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.072852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788592694.072870:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592694.072874:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225965440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592694.072880:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225965568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592694.072904:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592694.073020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225965568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.073027:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592694.073054:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225965568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788592694.200652:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788592695.165341:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfae918c0 20000000:00000080:3.0:1788592695.165358:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92186f513c00 uarg=0000000000000000 20000000:01000000:3.0:1788592695.165397:0:10388:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788592695.165402:0:10388:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788592695.165407:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788592695.165917:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788592695.166192:0:10388:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788592695.171028:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788592695.171210:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788592695.171230:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788592695.171245:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788592695.171266:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171297:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171306:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171314:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171321:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171330:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171338:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171377:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171394:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 9 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.171409:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225965696:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592695.171508:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171515:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 23 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.171524:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225965824:0@lo:104: 00000100:00100000:3.0:1788592695.171572:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592695.171628:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171636:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 23 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.171643:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225965952:0@lo:104: 00000100:00100000:3.0:1788592695.171670:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592695.171696:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171705:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 23 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.171713:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225966080:0@lo:104: 00010000:00010000:3.0:1788592695.171748:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.171756:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 23 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.171763:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225966208:0@lo:104: 00000100:00100000:3.0:1788592695.171787:0:10388:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217424679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592695.172041:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788592695.172061:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592695.172113:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592695.172123:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965824 00000100:00100000:2.0:1788592695.172130:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965824 00000100:00100000:2.0:1788592695.172165:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225965952 00000100:00100000:2.0:1788592695.172169:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225965952 00000100:00100000:2.0:1788592695.172178:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966080 00000100:00100000:2.0:1788592695.172181:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966080 00000100:00100000:2.0:1788592695.172189:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966208 00000100:00100000:2.0:1788592695.172192:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966208 00000100:00100000:2.0:1788592695.172205:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592695.172221:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:10388:x1875475225965824:12345-0@lo:104: 00010000:00010000:2.0:1788592695.172233:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172295:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592695.172301:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:10388:x1875475225965824:12345-0@lo:104: Request processed in 83us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592695.172309:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592695.172326:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592695.172331:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174391ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10388:x1875475225965952:12345-0@lo:104: 00010000:00010000:2.0:1788592695.172338:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172370:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592695.172376:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174391ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:10388:x1875475225965952:12345-0@lo:104: Request processed in 45us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592695.172381:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592695.172411:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592695.172417:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10388:x1875475225966080:12345-0@lo:104: 00010000:00010000:2.0:1788592695.172424:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172454:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788592695.172458:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:10388:x1875475225966080:12345-0@lo:104: Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592695.172463:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592695.172474:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788592695.172486:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:10388:x1875475225966208:12345-0@lo:104: 00010000:00010000:2.0:1788592695.172493:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172521:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788592695.172525:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:10388:x1875475225966208:12345-0@lo:104: Request processed in 41us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592695.172530:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788592695.172546:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788592695.172562:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172569:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592695.172573:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172582:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592695.172589:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592695.172595:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592695.172624:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172630:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592695.172646:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172664:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80000/0xbd314a3362db4bc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4bcc expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172676:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788592695.172680:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172685:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592695.172688:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172695:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592695.172701:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592695.172707:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592695.172720:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172726:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592695.172916:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172924:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840030000/0xbd314a3362db4a9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4aa6 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172936:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592695.172945:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172951:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b521600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592695.172953:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172959:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592695.172965:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592695.172969:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592695.172982:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172987:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592695.172993:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.172998:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b521600/0xbd314a3362db4a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a52 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.173006:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592695.173008:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.173013:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592695.173015:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.173030:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592695.173035:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592695.173040:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592695.173051:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.173056:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592695.173062:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.173089:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9218821cb000/0xbd314a3362db4a2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4a36 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.173103:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592695.173104:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592695.173106:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592695.173112:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592695.173211:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225965824:0@lo:104: 00000100:00100000:3.0:1788592695.173219:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225965952:0@lo:104: 00000100:00100000:3.0:1788592695.173226:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225966080:0@lo:104: 00000100:00100000:3.0:1788592695.173233:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225966208:0@lo:104: 00010000:00010000:1.0:1788592695.173445:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592695.173458:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225966720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.173502:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592695.173539:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592695.173545:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225966336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.173576:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592695.173610:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225966464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.173631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592695.173650:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592695.173656:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225966592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.173676:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592695.173702:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966720 00000100:00100000:1.0:1788592695.173706:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966720 00010000:00010000:1.0:1788592695.173730:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 24 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.175008:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966336 00000100:00100000:3.0:1788592695.175019:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966336 00010000:00010000:3.0:1788592695.175048:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 25 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.175144:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966464 00000100:00100000:3.0:1788592695.175147:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966464 00010000:00010000:3.0:1788592695.175159:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 26 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.175168:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966592 00000100:00100000:3.0:1788592695.175171:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966592 00010000:00010000:3.0:1788592695.175180:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 27 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.175191:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592695.175198:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+27:3639:x1875475225966336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592695.175210:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592695.175214:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 27 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175223:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 27 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175238:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80400/0xbd314a3362db4bcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4bc5 expref: 27 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175261:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592695.175327:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+26:3639:x1875475225966336:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592695.175334:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592695.175349:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592695.175353:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+25:3641:x1875475225966464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592695.175361:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592695.175364:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 25 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175372:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 25 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175381:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b520600/0xbd314a3362db4aa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4a9f expref: 25 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175388:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592695.175412:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475225966464:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592695.175418:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592695.175432:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592695.175437:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffde450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3641:x1875475225966592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592695.175443:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592695.175447:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 23 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175454:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 23 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175468:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840030e00/0xbd314a3362db4a52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4a4b expref: 23 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.175477:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592695.175497:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffde450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3641:x1875475225966592:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592695.175503:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788592695.175709:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592695.175717:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3639:x1875475225966720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592695.176172:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592695.176177:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 21 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.176186:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 21 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.176196:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f400/0xbd314a3362db4a36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4a2f expref: 21 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.176205:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592695.176236:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3639:x1875475225966720:12345-0@lo:103:ldlm_bl.0 Request processed in 521us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592695.176250:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592695.176324:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225966592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.176332:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475225966464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.176357:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225966336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592695.176363:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225966720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592695.183817:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592695.183891:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132288 00000100:00100000:1.0:1788592695.183901:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132288 00010000:00010000:1.0:1788592695.183941:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 10 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592695.183987:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:1.0:1788592695.183996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2395:x1875475209132288:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592695.184009:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592695.184015:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 10 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184027:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 10 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184047:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184054:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184098:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184118:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184128:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184135:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184141:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592695.184145:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184154:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184163:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.184172:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592695.184224:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2395:x1875475209132288:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 229us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592695.184231:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 39 00010000:00010000:3.0:1788592695.184450:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839800/0xbd314a3362db4ce4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c71 expref: 9 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592695.184465:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875475225965696:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592695.184496:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.184505:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.184510:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592695.184516:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f200/0xbd314a3362db4da8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592695.225507:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788592695.992192:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592695.992198:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174243f000 from 4 10000000:01000000:0.0:1788592695.992202:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592695.992251:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592695.992263:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592695.992282:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592695.992315:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225966848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592695.992379:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592695.992416:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592695.992626:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966848 00000100:00100000:1.0:1788592695.992634:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966848 00000100:00100000:1.0:1788592695.992680:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788592695.992688:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225966848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592695.992700:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592695.992713:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4daf expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.992739:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4daf expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.992749:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4daf expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592695.992759:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839400, rc 0) 00000100:00100000:1.0:1788592695.992795:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225966848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592695.992802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788592695.992912:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225966848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592695.992925:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592695.992933:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592695.992988:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225966976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592695.993013:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592695.993035:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592695.993162:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225966976 00000100:00100000:1.0:1788592695.993166:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225966976 00000100:00100000:1.0:1788592695.993200:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788592695.993206:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225966976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592695.993512:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225966976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592695.993519:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788592695.993565:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225966976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592695.993592:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592695.993629:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592695.993687:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218454c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592695.997168:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967104 00000100:00100000:0.0:1788592695.997311:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967104 00000100:00100000:0.0:1788592695.997463:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788592695.997473:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225967104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592695.997630:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225967104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592695.997638:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788592695.998253:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592695.998475:0:10418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10418:1875475225967232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592695.998524:0:10418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.000592:0:10418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218454c93c0 going to sleep for 10 seconds 00000100:00100000:1.0:1788592696.000674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967232 00000100:00100000:1.0:1788592696.000682:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967232 00000100:00100000:1.0:1788592696.000720:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788592696.000729:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10418:x1875475225967232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.000871:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10418:x1875475225967232:12345-0@lo:502:llog_process_th.0 Request processed in 142us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.000878:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788592696.001004:0:10418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10418:1875475225967232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592696.001034:0:10418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592696.001043:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592696.001046:0:10418:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788592696.001053:0:10418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92174243f000 00000020:00000080:3.0:1788592696.001056:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788592696.001160:0:10418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10418:1875475225967360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592696.001211:0:10418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.001224:0:10418:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186961bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.003344:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967360 00000100:00100000:0.0:1788592696.003356:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967360 00000100:00100000:0.0:1788592696.003411:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788592696.003421:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10418:x1875475225967360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592696.003574:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:10418:x1875475225967360:12345-0@lo:502:llog_process_th.0 Request processed in 155us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.003590:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788592696.003725:0:10418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10418:1875475225967360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592696.003758:0:10418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592696.003766:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592696.003768:0:10418:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788592696.003774:0:10418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788592696.003933:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788592696.003951:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592696.003961:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.003972:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592696.003981:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592696.003984:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218764b9000 from 4 10000000:01000000:0.0:1788592696.003987:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592696.004017:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.004025:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.004035:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592696.004055:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.004131:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.004159:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218766770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.004171:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967488 00000100:00100000:0.0:1788592696.004187:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967488 00000100:00100000:0.0:1788592696.004208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788592696.004215:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225967488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592696.004223:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592696.004378:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4dbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.004403:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.004413:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.004422:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840031400, rc 0) 00000100:00100000:0.0:1788592696.004455:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225967488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.004461:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788592696.004496:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592696.004509:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.004518:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592696.004565:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.004588:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.004602:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.004612:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967616 00000100:00100000:0.0:1788592696.004615:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967616 00000100:00100000:0.0:1788592696.004629:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788592696.004634:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225967616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.004726:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225967616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.004738:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788592696.004766:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.004791:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.004824:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.004837:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.004848:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967744 00000100:00100000:0.0:1788592696.004851:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967744 00000100:00100000:0.0:1788592696.004866:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788592696.004870:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225967744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.004934:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225967744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.004941:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788592696.004976:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225967744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.005149:0:10419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10419:1875475225967872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592696.005717:0:10419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.005740:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225967872 00000100:00100000:0.0:1788592696.005744:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225967872 00000100:00100000:0.0:1788592696.005775:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788592696.005782:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10419:x1875475225967872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592696.005852:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10419:x1875475225967872:12345-0@lo:502:llog_process_th.0 Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.005859:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788592696.005885:0:10419:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.005896:0:10419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10419:1875475225967872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592696.005923:0:10419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592696.005930:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592696.005933:0:10419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592696.005938:0:10419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9218764b9000 00000020:00000080:0.0:1788592696.005940:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788592696.006000:0:10419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10419:1875475225968000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592696.006031:0:10419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.006048:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968000 00000100:00100000:0.0:1788592696.006051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968000 00000100:00100000:0.0:1788592696.006087:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788592696.006094:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10419:x1875475225968000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592696.006153:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:10419:x1875475225968000:12345-0@lo:502:llog_process_th.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.006159:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788592696.006196:0:10419:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.006207:0:10419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10419:1875475225968000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592696.006222:0:10419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592696.006226:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592696.006228:0:10419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788592696.006231:0:10419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788592696.007334:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788592696.007355:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592696.007371:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.007382:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592696.007392:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592696.007394:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921875948800 from 4 10000000:01000000:1.0:1788592696.007397:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592696.007422:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.007430:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.007439:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592696.007457:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.007504:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.007542:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921847dcf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.007587:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968128 00000100:00100000:0.0:1788592696.007592:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968128 00000100:00100000:0.0:1788592696.007626:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788592696.007633:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225968128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592696.007642:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592696.007652:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4dcb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.007683:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.007693:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.007702:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030000, rc 0) 00000100:00100000:0.0:1788592696.007734:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225968128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.007741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788592696.007777:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592696.007789:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.007799:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592696.007847:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.007872:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.007888:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592696.007903:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968256 00000100:00100000:0.0:1788592696.007906:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968256 00000100:00100000:0.0:1788592696.007929:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788592696.007936:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225968256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.008028:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225968256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.008044:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788592696.008105:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.008134:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592696.008587:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592696.008645:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842b9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592696.012526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968384 00000100:00100000:1.0:1788592696.012540:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968384 00000100:00100000:1.0:1788592696.012589:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788592696.012599:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225968384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.012744:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225968384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.012752:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788592696.012820:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.013035:0:10422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10422:1875475225968512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.013093:0:10422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.013118:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968512 00000100:00100000:1.0:1788592696.013122:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968512 00000100:00100000:1.0:1788592696.013145:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788592696.013152:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10422:x1875475225968512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.013218:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10422:x1875475225968512:12345-0@lo:502:llog_process_th.0 Request processed in 66us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.013224:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788592696.014380:0:10422:0:(client.c:2716:ptlrpc_set_wait()) set ffff921847dcf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592696.014409:0:10422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10422:1875475225968512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592696.014440:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592696.014450:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592696.014453:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788592696.014459:0:10422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff921875948800 00000020:00000080:1.0:1788592696.014462:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788592696.014544:0:10422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10422:1875475225968640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.014596:0:10422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.014621:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968640 00000100:00100000:1.0:1788592696.014626:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968640 00000100:00100000:1.0:1788592696.014657:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788592696.014665:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10422:x1875475225968640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.014746:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:10422:x1875475225968640:12345-0@lo:502:llog_process_th.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.014754:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788592696.014786:0:10422:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376240 going to sleep for 11 seconds 00000100:00100000:1.0:1788592696.014804:0:10422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10422:1875475225968640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592696.014819:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592696.014822:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592696.014824:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788592696.014827:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788592696.015508:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788592696.015536:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592696.015546:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592696.015559:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592696.015577:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592696.015580:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921846c66000 from 4 10000000:01000000:2.0:1788592696.015582:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592696.015609:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592696.015617:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592696.015626:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592696.015644:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592696.015687:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592696.015731:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92174244f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592696.015891:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968768 00000100:00100000:2.0:1788592696.015905:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968768 00000100:00100000:2.0:1788592696.017015:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788592696.017028:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225968768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592696.017043:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592696.017060:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4dd9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592696.017101:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592696.017112:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592696.017134:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80000, rc 0) 00000100:00100000:2.0:1788592696.017194:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225968768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.017201:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788592696.017484:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592696.017502:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.017511:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592696.017575:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.017639:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.018030:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376240 going to sleep for 11 seconds 00000100:00100000:1.0:1788592696.018048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225968896 00000100:00100000:1.0:1788592696.018053:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225968896 00000100:00100000:1.0:1788592696.018115:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788592696.018122:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225968896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.018318:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225968896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.018328:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788592696.018368:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225968896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.018402:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225969024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.018441:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.018460:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592696.019603:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969024 00000100:00100000:2.0:1788592696.019613:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969024 00000100:00100000:2.0:1788592696.019663:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788592696.019673:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225969024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592696.019787:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225969024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.019794:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788592696.020355:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225969024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.020563:0:10423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10423:1875475225969152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.020610:0:10423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.020640:0:10423:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592696.023123:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969152 00000100:00100000:2.0:1788592696.023135:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969152 00000100:00100000:2.0:1788592696.023183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788592696.023193:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:10423:x1875475225969152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592696.023354:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:10423:x1875475225969152:12345-0@lo:502:llog_process_th.0 Request processed in 163us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.023362:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788592696.024157:0:10423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10423:1875475225969152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592696.024207:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592696.024216:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592696.024220:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788592696.024227:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff921846c66000 00000020:00000080:1.0:1788592696.024231:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788592696.024329:0:10423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10423:1875475225969280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.024380:0:10423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592696.024410:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969280 00000100:00100000:1.0:1788592696.024415:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969280 00000100:00100000:1.0:1788592696.024457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788592696.024466:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:10423:x1875475225969280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592696.024547:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:10423:x1875475225969280:12345-0@lo:502:llog_process_th.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.024554:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788592696.024614:0:10423:0:(client.c:2716:ptlrpc_set_wait()) set ffff921848376cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592696.024628:0:10423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:10423:1875475225969280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592696.024646:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592696.024651:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592696.024653:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788592696.024657:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788592696.024718:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788592696.024744:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592696.024753:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.024763:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592696.120582:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592696.120604:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225969408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592696.120669:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592696.122399:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969408 00000100:00100000:2.0:1788592696.122412:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969408 00000100:00100000:2.0:1788592696.122473:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592696.122483:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225969408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592696.122513:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592696.122576:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225969408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.122594:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788592696.122646:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788592696.122680:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f514380 x1875475225969408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592696.122700:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225969408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592696.123669:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225969536:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124026:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124055:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225970048:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124114:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225970560:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124167:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788592696.124173:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225969664:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124223:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225970176:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124258:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225970688:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124311:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225969792:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124347:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225970304:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124367:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124384:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225970816:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124402:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124431:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788592696.124437:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225969920:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124457:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124468:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225970432:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124486:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592696.124512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969536 00000100:00100000:3.0:1788592696.124519:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969536 00000100:00100000:3.0:1788592696.124549:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970048 00000100:00100000:3.0:1788592696.124552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970048 00000100:00100000:3.0:1788592696.124570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970560 00000100:00100000:3.0:1788592696.124573:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970560 00000100:00100000:3.0:1788592696.124583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970176 00000100:00100000:3.0:1788592696.124585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970176 00000100:00100000:3.0:1788592696.124594:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970688 00000100:00100000:3.0:1788592696.124596:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970688 00000100:00100000:3.0:1788592696.124606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969920 00000100:00100000:3.0:1788592696.124612:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969920 00000100:00100000:3.0:1788592696.124630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788592696.124637:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225969536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.124682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225969536:12345-0@lo:400:kworker.0 Request processed in 44us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592696.125083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788592696.125121:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970304 00000100:00100000:2.0:1788592696.125126:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970304 00000100:00100000:2.0:1788592696.125155:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970816 00000100:00100000:2.0:1788592696.125158:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970816 00000100:00100000:2.0:1788592696.125173:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970432 00000100:00100000:2.0:1788592696.125175:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970432 00000100:00100000:2.0:1788592696.125187:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592696.125192:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225970304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592696.125231:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225970304:12345-0@lo:400:kworker.0 Request processed in 38us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.125237:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592696.125249:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592696.125255:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225970816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592696.125292:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225970816:12345-0@lo:400:kworker.0 Request processed in 37us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.125297:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592696.125307:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592696.125313:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225970432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592696.125336:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225970432:12345-0@lo:400:kworker.0 Request processed in 24us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.125341:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592696.125355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969664 00000100:00100000:2.0:1788592696.125358:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969664 00000100:00100000:2.0:1788592696.125387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225969792 00000100:00100000:2.0:1788592696.125390:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225969792 00000100:00100000:2.0:1788592696.125402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788592696.125414:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225969664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592696.125446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225969664:12345-0@lo:400:kworker.0 Request processed in 32us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.125452:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788592696.125463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788592696.125467:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225969792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592696.125503:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225969792:12345-0@lo:400:kworker.0 Request processed in 36us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.125509:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592696.125659:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592696.125668:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225970048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592696.125699:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225970048:12345-0@lo:400:kworker.0 Request processed in 34us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.125705:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592696.125719:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592696.125724:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225970560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592696.125750:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225970560:12345-0@lo:400:kworker.0 Request processed in 26us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.125756:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592696.125767:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592696.125774:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225970176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592696.125811:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225970176:12345-0@lo:400:kworker.0 Request processed in 37us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.125816:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592696.125826:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592696.125832:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592696.125852:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225970688:12345-0@lo:400:kworker.0 Request processed in 21us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.125857:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592696.125866:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592696.125871:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225969920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592696.125891:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225969920:12345-0@lo:400:kworker.0 Request processed in 20us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.125896:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788592696.126130:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592696.126135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592696.126138:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592696.126140:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592696.126175:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225969664:0@lo:400:kworker.0 00010000:00080000:0.0:1788592696.126190:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d50ad80 x1875475225970176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592696.126200:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225970176:0@lo:400:kworker.0 00010000:00080000:0.0:1788592696.126210:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d509c00 x1875475225970688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592696.126219:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225970688:0@lo:400:kworker.0 00000100:00100000:0.0:1788592696.126229:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225969536:0@lo:400:kworker.0 00000100:00100000:0.0:1788592696.126239:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225970048:0@lo:400:kworker.0 00000100:00100000:0.0:1788592696.126247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225970560:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.129628:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225969920:0@lo:400:kworker.0 00010000:00080000:3.0:1788592696.129649:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d50b480 x1875475225970432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592696.129660:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225970432:0@lo:400:kworker.0 00000100:00100000:3.0:1788592696.129672:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225969792:0@lo:400:kworker.0 00010000:00080000:3.0:1788592696.129683:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d50bb80 x1875475225970304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592696.129754:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225970304:0@lo:400:kworker.0 00010000:00080000:3.0:1788592696.129770:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437dad80 x1875475225970816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592696.129779:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225970816:0@lo:400:kworker.0 00010000:00010000:2.0:1788592696.249612:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592696.632249:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592696.632283:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225970944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592696.632350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592696.632396:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225970944 00000100:00100000:2.0:1788592696.632403:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225970944 00000100:00100000:2.0:1788592696.632448:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592696.632457:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225970944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592696.632476:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592696.632521:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225970944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.632529:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788592696.632570:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f514380 x1875475225970944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592696.632588:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225970944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592696.894362:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592696.896102:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132416 00000100:00100000:3.0:1788592696.896119:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132416 00000100:00100000:3.0:1788592696.896186:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 268 00000100:00100000:3.0:1788592696.896197:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+9:6162:x1875475209132416:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592696.896214:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592696.896231:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2cb7 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.896288:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.896299:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.896312:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f200, rc 0) 00000100:00100000:3.0:1788592696.896371:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209132416:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 176us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592696.896378:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 268 00000100:00100000:3.0:1788592696.902651:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592696.902702:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132544 00000100:00100000:3.0:1788592696.902712:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132544 00000100:00100000:3.0:1788592696.902761:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 269 00000100:00100000:3.0:1788592696.902771:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209132544:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592696.902920:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209132544:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 150us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592696.902929:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 269 00000100:00100000:3.0:1788592696.913478:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592696.913588:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132672 00000100:00100000:1.0:1788592696.913598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132672 00000100:00100000:1.0:1788592696.913653:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 270 00000100:00100000:1.0:1788592696.913663:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209132672:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592696.913805:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:6162:x1875475209132672:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.913813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 270 00000100:00100000:3.0:1788592696.928760:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592696.928847:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132800 00000100:00100000:0.0:1788592696.928857:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132800 00000100:00100000:0.0:1788592696.928911:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 271 00000100:00100000:0.0:1788592696.928921:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6711:x1875475209132800:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592696.929121:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:6711:x1875475209132800:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 201us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592696.929130:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 271 00000100:00100000:3.0:1788592696.937466:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592696.938026:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209132928 00000100:00100000:2.0:1788592696.938046:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209132928 00000100:00100000:2.0:1788592696.938293:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 272 00000100:00100000:2.0:1788592696.938304:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:6711:x1875475209132928:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592696.938445:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:6711:x1875475209132928:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 143us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.938454:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 272 00000100:00100000:1.0:1788592697.144354:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225971072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592697.144429:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592697.144659:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971072 00000100:00100000:2.0:1788592697.144668:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971072 00000100:00100000:2.0:1788592697.144733:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592697.144749:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225971072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788592697.144779:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592697.144848:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225971072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592697.144855:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788592697.145155:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437dad80 x1875475225971072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592697.145361:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225971200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592697.145362:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225971072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592697.145405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592697.145564:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971200 00000100:00100000:0.0:1788592697.145570:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971200 00000100:00100000:0.0:1788592697.145600:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592697.145607:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225971200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592697.145621:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592697.145665:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225971200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592697.145671:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788592697.146406:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bea00 x1875475225971200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592697.146425:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225971200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788592697.273447:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592698.297468:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592698.810242:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592698.810296:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592698.810321:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592698.811307:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133056 00000100:00100000:2.0:1788592698.811319:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133056 00000100:00100000:3.0:1788592698.811335:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592698.811371:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592698.811379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 273 00000100:00100000:2.0:1788592698.811394:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2396:x1875475209133056:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592698.811416:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133568 00000100:00100000:3.0:1788592698.811422:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133568 00000100:00100000:3.0:1788592698.811469:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133440 00000100:00100000:3.0:1788592698.811473:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133440 00000100:00100000:2.0:1788592698.811481:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2396:x1875475209133056:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 90us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592698.811500:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:2.0:1788592698.811501:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 273 00000100:00100000:3.0:1788592698.811516:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209133568:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592698.811550:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209133568:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592698.811557:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:3.0:1788592698.811578:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:3.0:1788592698.811585:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209133440:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592698.811608:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209133440:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592698.811614:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:3.0:1788592698.811633:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133312 00000100:00100000:3.0:1788592698.811637:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133312 00000100:00100000:3.0:1788592698.811690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133184 00000100:00100000:3.0:1788592698.811694:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133184 00000100:00100000:3.0:1788592698.811718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1788592698.811725:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209133312:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592698.811753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209133312:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592698.811759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1788592698.811772:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:3.0:1788592698.811778:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209133184:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592698.811800:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209133184:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592698.811814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00080000:3.0:1788592698.811836:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592698.811840:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592698.811843:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592698.811845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592699.196485:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225971328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592699.196559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592699.196647:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971328 00000100:00100000:2.0:1788592699.196656:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971328 00000100:00100000:2.0:1788592699.196725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788592699.196735:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225971328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592699.196769:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592699.196819:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225971328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592699.196825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788592699.196867:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225971328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592699.205880:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592699.205901:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225971456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592699.205968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592699.206018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971456 00000100:00100000:0.0:1788592699.206025:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971456 00000100:00100000:0.0:1788592699.206084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788592699.206095:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225971456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592699.206137:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592699.206185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225971456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592699.206192:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788592699.206237:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225971456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592699.324869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592700.344693:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592700.502603:0:10687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788592701.240594:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225971584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592701.240679:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.240757:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971584 00000100:00100000:2.0:1788592701.240764:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971584 00000100:00100000:2.0:1788592701.240820:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788592701.240830:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788592701.240832:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225971584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592701.240841:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:1.0:1788592701.240857:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788592701.240865:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592701.240915:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225971584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.240922:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788592701.240964:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f514e00 x1875475225971584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592701.240996:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225971584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592701.243361:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225971712:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243429:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.243491:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971712 00000100:00100000:2.0:1788592701.243499:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971712 00000100:00100000:2.0:1788592701.243537:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788592701.243546:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225971712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243593:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225971712:12345-0@lo:400:kworker.0 Request processed in 48us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.243600:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788592701.243645:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225971712:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243705:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225971840:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243731:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.243761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971840 00000100:00100000:2.0:1788592701.243764:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971840 00000100:00100000:2.0:1788592701.243788:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592701.243793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225971840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243824:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225971840:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.243829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592701.243854:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225971840:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243882:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225971968:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.243906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.243943:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225971968 00000100:00100000:2.0:1788592701.243946:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225971968 00000100:00100000:2.0:1788592701.243969:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592701.243974:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225971968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244006:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225971968:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.244012:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592701.244034:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225971968:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244063:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225972096:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.244138:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972096 00000100:00100000:2.0:1788592701.244141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972096 00000100:00100000:2.0:1788592701.244161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592701.244167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225972096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244198:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225972096:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.244204:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592701.244230:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225972096:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244274:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225972224:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.244325:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972224 00000100:00100000:2.0:1788592701.244329:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972224 00000100:00100000:2.0:1788592701.244351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592701.244357:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225972224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244390:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225972224:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.244404:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592701.244434:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225972224:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244468:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225972352:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.244511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972352 00000100:00100000:2.0:1788592701.244514:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972352 00000100:00100000:2.0:1788592701.244548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788592701.244554:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225972352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244589:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225972352:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.244595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788592701.244611:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592701.244632:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225972352:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244674:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592701.244681:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225972480:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244703:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.244725:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972480 00000100:00100000:2.0:1788592701.244728:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972480 00000100:00100000:2.0:1788592701.244753:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592701.244759:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225972480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244790:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225972480:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.244796:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788592701.244812:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788592701.244830:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921876655c00 x1875475225972480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592701.244847:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225972480:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244881:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225972608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.244906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.244933:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972608 00000100:00100000:2.0:1788592701.244937:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972608 00000100:00100000:2.0:1788592701.244978:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592701.244985:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225972608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245015:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225972608:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.245021:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788592701.245038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788592701.245055:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921876655c00 x1875475225972608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592701.245082:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225972608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225972736:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.245164:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972736 00000100:00100000:2.0:1788592701.245167:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972736 00000100:00100000:2.0:1788592701.245198:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592701.245206:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225972736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245251:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225972736:12345-0@lo:400:kworker.0 Request processed in 47us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.245257:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788592701.245271:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788592701.245294:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f0380 x1875475225972736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592701.245304:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225972736:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245372:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225973120:0@lo:400:kworker.0 00000100:00100000:0.0:1788592701.245382:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475225972992:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245399:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592701.245421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.245435:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973120 00000100:00100000:2.0:1788592701.245440:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973120 00000100:00100000:0.0:1788592701.245465:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592701.245477:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592701.245477:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225972864:0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245487:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225973120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592701.245509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592701.245534:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225973120:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.245541:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788592701.245557:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592701.245564:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972992 00000100:00100000:0.0:1788592701.245569:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972992 00010000:00080000:2.0:1788592701.245579:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b20000 x1875475225973120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592701.245588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225973120:0@lo:400:kworker.0 00000100:00080000:2.0:1788592701.245604:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592701.245605:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225972864 00000100:00100000:0.0:1788592701.245610:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225972864 00000100:00100000:2.0:1788592701.245618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788592701.245628:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475225972992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592701.245638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788592701.245647:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225972864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592701.245664:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475225972992:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592701.245671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788592701.245687:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788592701.245702:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b22a00 x1875475225972992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592701.245711:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475225972992:0@lo:400:kworker.0 00000100:00100000:0.0:1788592701.245800:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225972864:12345-0@lo:400:kworker.0 Request processed in 154us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592701.245807:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788592701.254807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225972864:0@lo:400:kworker.0 00010000:00010000:2.0:1788592701.368209:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592701.752401:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592701.752424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225973248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592701.752493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592701.752593:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973248 00000100:00100000:0.0:1788592701.752602:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973248 00000100:00100000:0.0:1788592701.752662:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788592701.752672:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225973248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788592701.752696:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592701.752755:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225973248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592701.752762:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788592701.754143:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b22a00 x1875475225973248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592701.754179:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225973248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592702.264519:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592702.264548:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225973376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592702.264623:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592702.265097:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973376 00000100:00100000:1.0:1788592702.265107:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973376 00000100:00100000:1.0:1788592702.265165:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788592702.265175:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225973376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592702.265204:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788592702.265417:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bd500 x1875475225973376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592702.265437:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225973376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592702.265495:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225973376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592702.265502:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592702.266495:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225973504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592702.266543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592702.266677:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973504 00000100:00100000:1.0:1788592702.266684:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973504 00000100:00100000:1.0:1788592702.266727:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592702.266735:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225973504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592702.266753:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592702.266802:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225973504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592702.266808:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788592702.266877:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bc700 x1875475225973504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592702.266894:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225973504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788592702.392318:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592703.416282:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592703.930620:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592703.930669:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592703.930698:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592703.930717:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592703.930745:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592703.930784:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133952 00000100:00100000:2.0:1788592703.930796:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133952 00000100:00100000:2.0:1788592703.930868:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133824 00000100:00100000:2.0:1788592703.930872:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133824 00000100:00100000:2.0:1788592703.930915:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:2.0:1788592703.930927:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209133952:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592703.931023:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209133952:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 99us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592703.931032:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:2.0:1788592703.931054:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:2.0:1788592703.931060:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209133824:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592703.931110:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209133824:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592703.931117:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:2.0:1788592703.931153:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134208 00000100:00100000:2.0:1788592703.931157:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134208 00000100:00100000:2.0:1788592703.931185:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134080 00000100:00100000:2.0:1788592703.931188:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134080 00000100:00100000:2.0:1788592703.931208:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:2.0:1788592703.931234:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209134208:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592703.931262:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209134208:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 47us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592703.931269:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:2.0:1788592703.931281:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:2.0:1788592703.931288:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209134080:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592703.931309:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209134080:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592703.931316:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00080000:2.0:1788592703.931340:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592703.931350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592703.931353:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592703.931355:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592703.938619:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209133696 00000100:00100000:3.0:1788592703.938637:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209133696 00000100:00100000:3.0:1788592703.938787:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 275 00000100:00100000:3.0:1788592703.938799:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:2395:x1875475209133696:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592703.938891:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:2395:x1875475209133696:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 95us (8284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592703.938899:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 275 00000100:00100000:2.0:1788592704.312446:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592704.312478:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225973632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592704.312573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592704.312655:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973632 00000100:00100000:2.0:1788592704.312664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973632 00000100:00100000:2.0:1788592704.312723:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592704.312733:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225973632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592704.312776:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592704.312825:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225973632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592704.312832:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592704.312885:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225973632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592704.314096:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225973760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592704.314181:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592704.314460:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973760 00000100:00100000:2.0:1788592704.314468:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973760 00000100:00100000:2.0:1788592704.314526:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788592704.314537:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225973760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592704.314573:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788592704.314641:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225973760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592704.314649:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788592704.326559:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225973760:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592704.441306:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592705.464411:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592705.641269:0:10932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing yml_node 00000100:00100000:3.0:1788592706.360334:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225974272:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.360363:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225973888:0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.360463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225974144:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361734:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225974400:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361769:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361801:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225974912:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361824:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361841:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225975424:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361883:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788592706.361890:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225974016:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361912:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361928:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225974528:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361946:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361961:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225975040:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.361980:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.361995:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225975552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592706.362028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.362089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974400 00000100:00100000:2.0:1788592706.362097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974400 00000100:00100000:2.0:1788592706.362135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974016 00000100:00100000:2.0:1788592706.362138:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974016 00000100:00100000:2.0:1788592706.362150:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974528 00000100:00100000:2.0:1788592706.362152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974528 00000100:00100000:2.0:1788592706.362170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975040 00000100:00100000:2.0:1788592706.362173:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975040 00000100:00100000:2.0:1788592706.362189:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592706.362210:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225974400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362268:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225974400:12345-0@lo:400:kworker.0 Request processed in 72us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362449:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592706.362468:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788592706.362481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225974016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362515:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225974016:12345-0@lo:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362520:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788592706.362532:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788592706.362537:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225974528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225974528:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362567:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788592706.362577:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788592706.362582:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225975040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362606:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225975040:12345-0@lo:400:kworker.0 Request processed in 24us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362611:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788592706.362630:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974912 00000100:00100000:2.0:1788592706.362634:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974912 00000100:00100000:2.0:1788592706.362658:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975424 00000100:00100000:2.0:1788592706.362661:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975424 00000100:00100000:2.0:1788592706.362675:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592706.362682:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225974912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362712:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225974912:12345-0@lo:400:kworker.0 Request processed in 30us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362718:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592706.362728:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592706.362734:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225975424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362760:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225975424:12345-0@lo:400:kworker.0 Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362772:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592706.362805:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975552 00000100:00100000:2.0:1788592706.362808:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975552 00000100:00100000:2.0:1788592706.362834:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592706.362841:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225975552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592706.362873:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592706.362906:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225975552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.362911:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788592706.362926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592706.362929:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592706.362932:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592706.362965:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225974016:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362975:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225974528:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.362983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225975040:0@lo:400:kworker.0 00010000:00080000:2.0:1788592706.362994:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743837b80 x1875475225975552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592706.363008:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225975552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592706.363018:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225974400:0@lo:400:kworker.0 00010000:00080000:2.0:1788592706.363027:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4d500 x1875475225974912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592706.363036:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225974912:0@lo:400:kworker.0 00010000:00080000:2.0:1788592706.363045:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4ca80 x1875475225975424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592706.363058:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225975424:0@lo:400:kworker.0 00000100:00100000:3.0:1788592706.363665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592706.363707:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225974784:0@lo:400:kworker.0 00000100:00100000:3.0:1788592706.363740:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592706.363757:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225975296:0@lo:400:kworker.0 00000100:00100000:3.0:1788592706.363778:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.364008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.364045:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225974656:0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.364119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225975168:0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364159:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.364235:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974272 00000100:00100000:1.0:1788592706.364241:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974272 00000100:00100000:1.0:1788592706.364274:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974144 00000100:00100000:1.0:1788592706.364277:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974144 00000100:00100000:1.0:1788592706.364291:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788592706.364298:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225974272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364345:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225974272:12345-0@lo:400:kworker.0 Request processed in 47us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.364351:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788592706.364365:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788592706.364371:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225974144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364403:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225974144:12345-0@lo:400:kworker.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.364410:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788592706.364448:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225974272:0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364476:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974656 00000100:00100000:1.0:1788592706.364480:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974656 00000100:00100000:1.0:1788592706.364803:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975168 00000100:00100000:1.0:1788592706.364808:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975168 00000100:00100000:1.0:1788592706.364834:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788592706.364841:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225974656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364875:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225974656:12345-0@lo:400:kworker.0 Request processed in 34us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.364902:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788592706.364915:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788592706.364921:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225975168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592706.364950:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225975168:12345-0@lo:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.364956:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788592706.364998:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592706.365020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225974144:0@lo:400:kworker.0 00010000:00080000:1.0:1788592706.365033:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4df80 x1875475225974656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592706.365044:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225974656:0@lo:400:kworker.0 00010000:00080000:1.0:1788592706.365057:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4c000 x1875475225975168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592706.365099:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225975168:0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.365124:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225974784 00000100:00100000:2.0:1788592706.365131:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225974784 00000100:00080000:1.0:1788592706.365154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592706.365165:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975296 00000100:00100000:2.0:1788592706.365169:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975296 00000100:00100000:2.0:1788592706.365207:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788592706.365208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592706.365217:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225974784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.365420:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225974784:12345-0@lo:400:kworker.0 Request processed in 57us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.365429:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592706.365443:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592706.365450:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225975296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592706.365481:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225975296:12345-0@lo:400:kworker.0 Request processed in 33us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.365487:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788592706.366102:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4ce00 x1875475225974784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592706.366117:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225974784:0@lo:400:kworker.0 00010000:00080000:1.0:1788592706.366149:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4dc00 x1875475225975296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592706.366169:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225975296:0@lo:400:kworker.0 00000100:00100000:0.0:1788592706.367425:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225973888 00000100:00100000:0.0:1788592706.367435:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225973888 00000100:00100000:0.0:1788592706.367490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788592706.367500:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225973888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592706.367572:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225973888:12345-0@lo:400:kworker.0 Request processed in 74us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.367590:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788592706.367750:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225973888:0@lo:400:kworker.0 00010000:00010000:3.0:1788592706.489340:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592706.872513:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225975680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592706.872637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592706.872754:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975680 00000100:00100000:0.0:1788592706.872766:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975680 00000100:00100000:2.0:1788592706.872946:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592706.872961:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225975680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592706.872991:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592706.873053:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225975680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.873101:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788592706.873121:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b52300 x1875475225975680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592706.873240:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225975680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592707.384861:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592707.384898:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225975808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592707.385006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592707.385098:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975808 00000100:00100000:1.0:1788592707.385107:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975808 00000100:00100000:1.0:1788592707.385171:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592707.385182:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225975808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592707.385228:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592707.385293:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225975808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592707.385302:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592707.385658:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225975936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592707.385702:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788592707.385740:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b53100 x1875475225975808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592707.385763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225975808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592707.385942:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225975936 00000100:00100000:1.0:1788592707.385948:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225975936 00000100:00100000:1.0:1788592707.386027:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592707.386036:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225975936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592707.386050:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592707.386114:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225975936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592707.386122:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788592707.386180:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bf480 x1875475225975936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592707.386204:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225975936:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788592707.512918:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592708.536346:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592709.059985:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592709.060028:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592709.060054:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592709.060150:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592709.060194:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134720 00000100:00100000:3.0:1788592709.060206:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134720 00000100:00100000:3.0:1788592709.060289:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:3.0:1788592709.060301:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d6dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2392:x1875475209134720:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:3.0:1788592709.060346:0:8590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4cf9 00000100:00080000:3.0:1788592709.060359:0:8590:0:(import.c:65:import_set_state_nolock()) ffff92174282a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592709.060421:0:8590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788592709.060618:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d6dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+2:2392:x1875475209134720:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 319us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592709.060627:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:3.0:1788592709.060834:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134336 00000100:00100000:3.0:1788592709.060837:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134336 00000100:00100000:3.0:1788592709.060872:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 277 00000100:00100000:3.0:1788592709.060878:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2393:x1875475209134336:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592709.060903:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2393:x1875475209134336:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592709.060910:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 277 00000100:00100000:3.0:1788592709.060932:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134592 00000100:00100000:3.0:1788592709.060935:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134592 00000100:00100000:3.0:1788592709.060961:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134464 00000100:00100000:3.0:1788592709.060963:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134464 00000100:00100000:3.0:1788592709.060981:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:3.0:1788592709.061006:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209134592:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592709.061033:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209134592:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592709.061040:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:3.0:1788592709.061052:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:3.0:1788592709.061058:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209134464:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592709.061101:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209134464:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592709.061107:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00080000:3.0:1788592709.061127:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592709.061131:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592709.061133:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788592709.061146:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592709.062422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592709.062460:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134848 00000100:00100000:3.0:1788592709.062469:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134848 00000100:00100000:3.0:1788592709.062521:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:3.0:1788592709.062530:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2392:x1875475209134848:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:3.0:1788592709.062563:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4d00 00000100:00080000:3.0:1788592709.062574:0:8427:0:(import.c:65:import_set_state_nolock()) ffff92174282c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592709.062621:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788592709.064733:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+2:2392:x1875475209134848:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 2188us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592709.064806:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00010000:00010000:3.0:1788592709.064847:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592709.064857:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592709.432408:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592709.432440:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225976064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592709.432538:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592709.432586:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976064 00000100:00100000:1.0:1788592709.432598:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976064 00000100:00100000:1.0:1788592709.432667:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788592709.432699:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225976064:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592709.432733:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225976192:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592709.432757:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788592709.432765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592709.432820:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225976064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592709.432827:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788592709.432847:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225976064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592709.432849:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976192 00000100:00100000:1.0:1788592709.432856:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976192 00000100:00100000:1.0:1788592709.432877:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788592709.432884:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225976192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592709.432902:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592709.432942:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225976192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592709.432949:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788592709.432977:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225976192:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592709.560404:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592709.703053:0:11116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788592710.589021:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592711.480386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225976320:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480503:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225976832:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225977344:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480564:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480586:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225977856:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480612:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480646:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788592711.480652:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225976704:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480691:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225977216:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480725:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225977728:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480741:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480769:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225976448:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480808:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480829:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225976960:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480849:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480865:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225977472:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480883:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480911:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788592711.480917:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225976576:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480937:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480954:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225977088:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.480981:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225977600:0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.480996:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592711.481022:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976320 00000100:00100000:2.0:1788592711.481030:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976320 00000100:00100000:2.0:1788592711.481103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788592711.481114:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225976320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.481173:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225976320:12345-0@lo:400:kworker.0 Request processed in 52us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592711.481181:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788592711.481212:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976832 00000100:00100000:2.0:1788592711.481215:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976832 00000100:00100000:2.0:1788592711.481240:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976448 00000100:00100000:2.0:1788592711.481243:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976448 00000100:00100000:2.0:1788592711.481261:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976960 00000100:00100000:2.0:1788592711.481264:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976960 00000100:00100000:2.0:1788592711.481295:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977472 00000100:00100000:2.0:1788592711.481298:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977472 00000100:00100000:2.0:1788592711.481319:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977088 00000100:00100000:2.0:1788592711.481322:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977088 00000100:00100000:2.0:1788592711.481341:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977600 00000100:00100000:2.0:1788592711.481344:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977600 00000100:00100000:2.0:1788592711.481369:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788592711.481892:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788592711.482453:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976704 00000100:00100000:1.0:1788592711.482458:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976704 00000100:00100000:2.0:1788592711.482503:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225976832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.482559:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225976832:12345-0@lo:400:kworker.0 Request processed in 1184us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592711.482573:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788592711.482592:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788592711.482638:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225976448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.482740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225976448:12345-0@lo:400:kworker.0 Request processed in 839us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592711.482748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788592711.482764:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788592711.482771:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225977472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.482804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225977472:12345-0@lo:400:kworker.0 Request processed in 34us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592711.482818:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788592711.482833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788592711.482840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225977088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.482873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225977088:12345-0@lo:400:kworker.0 Request processed in 34us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592711.482879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788592711.482890:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788592711.482897:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225977600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.482925:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225977600:12345-0@lo:400:kworker.0 Request processed in 29us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592711.482930:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788592711.482957:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977344 00000100:00100000:0.0:1788592711.482962:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977344 00000100:00100000:0.0:1788592711.483001:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977856 00000100:00100000:0.0:1788592711.483005:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977856 00000100:00100000:3.0:1788592711.483009:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977216 00000100:00100000:3.0:1788592711.483016:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977216 00000100:00100000:0.0:1788592711.483023:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977728 00000100:00100000:0.0:1788592711.483028:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977728 00000100:00100000:3.0:1788592711.483050:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788592711.483057:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592711.483091:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225977344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.483135:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225977856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592711.483136:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225977344:12345-0@lo:400:kworker.0 Request processed in 75us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592711.483149:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788592711.483180:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788592711.483188:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225977856:12345-0@lo:400:kworker.0 Request processed in 123us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592711.483190:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225977216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.483203:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788592711.483219:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788592711.483228:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225977728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592711.483235:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225977216:12345-0@lo:400:kworker.0 Request processed in 47us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592711.483242:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788592711.483264:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225977728:12345-0@lo:400:kworker.0 Request processed in 37us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592711.483280:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788592711.484050:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225977984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592711.484120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788592711.484161:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b50000 x1875475225977088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592711.484184:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225977088:0@lo:400:kworker.0 00010000:00080000:0.0:1788592711.484196:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b53480 x1875475225977600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592711.484204:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225977600:0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.484214:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225976448:0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.484223:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225977472:0@lo:400:kworker.0 00000100:00100000:0.0:1788592711.484337:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225977984 00000100:00100000:0.0:1788592711.484342:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225977984 00000100:00100000:0.0:1788592711.484372:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592711.484511:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225976576 00000100:00100000:1.0:1788592711.484515:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225976576 00000100:00100000:1.0:1788592711.484528:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592711.484536:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225976704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592711.484578:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225976704:12345-0@lo:400:kworker.0 Request processed in 44us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592711.484585:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592711.484599:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592711.484605:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225976576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592711.484636:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225976576:12345-0@lo:400:kworker.0 Request processed in 32us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592711.484642:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592711.484700:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225976576:0@lo:400:kworker.0 00000100:00100000:1.0:1788592711.484763:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225976704:0@lo:400:kworker.0 00010000:00080000:1.0:1788592711.484776:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b51c00 x1875475225977216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592711.484786:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225977216:0@lo:400:kworker.0 00010000:00080000:1.0:1788592711.484798:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b52d80 x1875475225977728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592711.484806:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225977728:0@lo:400:kworker.0 00000100:00100000:1.0:1788592711.484815:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225976320:0@lo:400:kworker.0 00000100:00100000:1.0:1788592711.484826:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225976832:0@lo:400:kworker.0 00010000:00080000:1.0:1788592711.484836:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b50a80 x1875475225977344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592711.484844:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225977344:0@lo:400:kworker.0 00010000:00080000:1.0:1788592711.484853:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b52a00 x1875475225977856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592711.484860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225977856:0@lo:400:kworker.0 00000100:00080000:1.0:1788592711.485005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592711.485010:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592711.485014:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592711.485017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592711.485110:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225977984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592711.485135:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592711.485185:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225977984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 806us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592711.485192:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788592711.486160:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225976960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592711.486218:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225976960:12345-0@lo:400:kworker.0 Request processed in 3619us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592711.486226:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1788592711.486409:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743837b80 x1875475225977984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592711.486428:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225977984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592711.486452:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225976960:0@lo:400:kworker.0 00010000:00010000:3.0:1788592711.608665:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592711.992479:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225978112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592711.992624:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592711.993854:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978112 00000100:00100000:1.0:1788592711.993866:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978112 00000100:00100000:1.0:1788592711.993936:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788592711.993945:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225978112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592711.993968:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592711.994029:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225978112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592711.994037:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788592711.994088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743837b80 x1875475225978112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592711.994447:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225978112:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788592712.020549:0:11213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:1.0:1788592712.505273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225978368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592712.505341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592712.505384:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592712.505392:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225978240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592712.505416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592712.505733:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978368 00000100:00100000:1.0:1788592712.505741:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978368 00000100:00100000:1.0:1788592712.505785:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978240 00000100:00100000:1.0:1788592712.505788:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978240 00000100:00100000:1.0:1788592712.505804:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592712.505813:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225978368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592712.505840:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592712.505888:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225978368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592712.505905:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592712.505921:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788592712.505927:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225978240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592712.505936:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592712.505959:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225978240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592712.505964:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788592712.505994:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bca80 x1875475225978240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592712.506011:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225978240:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788592712.506021:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bfb80 x1875475225978368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592712.506030:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225978368:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788592712.633170:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592713.656733:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592714.168289:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592714.168427:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592714.168534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135104 00000100:00100000:0.0:1788592714.168544:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135104 00000100:00100000:0.0:1788592714.168647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:0.0:1788592714.168658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209135104:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592714.168738:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209135104:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 81us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592714.168746:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00080000:3.0:1788592714.169039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592714.169585:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209134976 00000100:00100000:1.0:1788592714.169592:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209134976 00000100:00100000:1.0:1788592714.169635:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 279 00000100:00100000:1.0:1788592714.169644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2394:x1875475209134976:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592714.169697:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2394:x1875475209134976:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 54us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592714.169704:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 279 00000100:00100000:3.0:1788592714.170284:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592714.174084:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135232 00000100:00100000:1.0:1788592714.174101:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135232 00000100:00100000:1.0:1788592714.174188:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00100000:1.0:1788592714.174200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209135232:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592714.174287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209135232:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 89us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592714.174295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00080000:3.0:1788592714.177708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1788592714.190657:0:11310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:0.0:1788592714.552604:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225978496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592714.552670:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592714.552846:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592714.552856:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225978624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592714.552905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592714.553193:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978496 00000100:00100000:1.0:1788592714.553202:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978496 00000100:00100000:1.0:1788592714.553252:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978624 00000100:00100000:1.0:1788592714.553255:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978624 00000100:00100000:1.0:1788592714.553272:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592714.553325:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225978496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592714.553359:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592714.553409:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225978496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592714.553417:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592714.553432:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788592714.553438:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225978624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592714.553454:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788592714.553481:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225978624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592714.553486:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788592714.553523:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225978624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592714.553538:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225978496:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788592714.554509:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:1.0:1788592714.554515:0:9505:0:(genops.c:885:class_export_put()) final put ffff92174282b800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:0.0:1788592714.554683:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92174282b800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-OST0001 00000020:00000080:0.0:1788592714.554738:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92174282c800 for lustre-OST0001 00000001:00100000:0.0:1788592714.555177:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:0.0:1788592714.555182:0:8422:0:(genops.c:885:class_export_put()) final put ffff92174282f000/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:1.0:1788592714.555221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92174282f000/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-OST0000 00000020:00000080:1.0:1788592714.555258:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92174282a800 for lustre-OST0000 00010000:00010000:3.0:1788592714.681362:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592715.705970:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592715.783936:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 03:18:34 EDT 2026 00000100:00100000:1.0:1788592716.601329:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592716.601355:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225978752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592716.601438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592716.601835:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978752 00000100:00100000:0.0:1788592716.601844:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978752 00000100:00100000:0.0:1788592716.601920:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788592716.601931:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225978752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592716.601980:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788592716.602005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592716.602050:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225978752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592716.602057:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788592716.602970:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437bea00 x1875475225978752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592716.602992:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225978752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592716.603567:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225979008:0@lo:400:kworker.0 00000100:00100000:2.0:1788592716.603602:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225978880:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.603619:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592716.603636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592716.603643:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225979520:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.603662:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592716.603663:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225979392:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.603675:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225980032:0@lo:400:kworker.0 00000100:00100000:2.0:1788592716.603681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592716.603697:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225979904:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.603706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592716.603721:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592716.603727:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788592716.603732:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225979136:0@lo:400:kworker.0 00000100:00100000:2.0:1788592716.603746:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788592716.603751:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225979264:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.603754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592716.603772:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225979648:0@lo:400:kworker.0 00000100:00100000:2.0:1788592716.603783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592716.603809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225979776:0@lo:400:kworker.0 00000100:00100000:2.0:1788592716.603839:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592716.603856:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225980288:0@lo:400:kworker.0 00000100:00100000:0.0:1788592716.603980:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979008 00000100:00100000:0.0:1788592716.603987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979008 00000100:00100000:0.0:1788592716.604019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979520 00000100:00100000:0.0:1788592716.604022:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979520 00000100:00100000:2.0:1788592716.604063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592716.604217:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979392 00000100:00100000:0.0:1788592716.604221:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979392 00000100:00100000:0.0:1788592716.604231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980032 00000100:00080000:2.0:1788592716.604234:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592716.604234:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980032 00000100:00080000:2.0:1788592716.604250:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592716.604256:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788592716.604265:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225979008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592716.604315:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979904 00000100:00100000:3.0:1788592716.604319:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979904 00000100:00100000:0.0:1788592716.604321:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225979008:12345-0@lo:400:kworker.0 Request processed in 57us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592716.604327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788592716.604346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788592716.604352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225979520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592716.604381:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225979520:12345-0@lo:400:kworker.0 Request processed in 30us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592716.604386:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788592716.604388:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979776 00000100:00100000:3.0:1788592716.604390:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979776 00000100:00100000:0.0:1788592716.604397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788592716.604451:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592716.604464:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225980160:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.604484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592716.604506:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225979008:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.604516:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225979520:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.604549:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225978880 00000100:00100000:1.0:1788592716.604553:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225978880 00000100:00100000:1.0:1788592716.604581:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788592716.604588:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225978880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.604623:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225978880:12345-0@lo:400:kworker.0 Request processed in 36us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592716.604630:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788592716.604656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979648 00000100:00100000:1.0:1788592716.604660:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979648 00000100:00100000:0.0:1788592716.605388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225979392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592716.605444:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225979392:12345-0@lo:400:kworker.0 Request processed in 1040us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592716.605452:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592716.605469:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980160 00000100:00100000:0.0:1788592716.605473:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980160 00000100:00080000:2.0:1788592716.606677:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592716.606685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592716.609058:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980288 00000100:00100000:3.0:1788592716.609084:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980288 00000100:00100000:3.0:1788592716.609115:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592716.609125:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225979904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592716.609220:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225979904:12345-0@lo:400:kworker.0 Request processed in 96us (5498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592716.609227:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592716.609244:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788592716.609251:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225979776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592716.609279:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225979776:12345-0@lo:400:kworker.0 Request processed in 29us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592716.609285:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788592716.609295:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592716.609301:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225980288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592716.609329:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225980288:12345-0@lo:400:kworker.0 Request processed in 28us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592716.609334:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788592716.609933:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592716.617465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788592716.617492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225980032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225980032:12345-0@lo:400:kworker.0 Request processed in 109us (13888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592716.617603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788592716.617622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788592716.617629:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225979648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617657:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475225979648:12345-0@lo:400:kworker.0 Request processed in 29us (13206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592716.617659:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225980032:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1788592716.617686:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4f480 x1875475225979648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592716.617689:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979136 00000100:00100000:1.0:1788592716.617694:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979136 00000100:00100000:2.0:1788592716.617696:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475225979648:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617722:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225979264 00000100:00100000:1.0:1788592716.617725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225979264 00000100:00100000:1.0:1788592716.617739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788592716.617745:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225979136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617790:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225979136:12345-0@lo:400:kworker.0 Request processed in 45us (14034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592716.617796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788592716.617807:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788592716.617813:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225979264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617842:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225979264:12345-0@lo:400:kworker.0 Request processed in 29us (14057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592716.617848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788592716.617858:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225979136:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617885:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225979264:0@lo:400:kworker.0 00010000:00080000:1.0:1788592716.617899:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4ed80 x1875475225979776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592716.617920:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225979776:0@lo:400:kworker.0 00010000:00080000:1.0:1788592716.617936:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4df80 x1875475225980288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592716.617944:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225980288:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.617955:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225978880:0@lo:400:kworker.0 00000100:00100000:1.0:1788592716.618140:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225979392:0@lo:400:kworker.0 00010000:00080000:1.0:1788592716.618152:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4dc00 x1875475225979904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592716.618159:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225979904:0@lo:400:kworker.0 00000100:00100000:0.0:1788592716.618505:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788592716.618513:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225980160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592716.618557:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475225980160:12345-0@lo:400:kworker.0 Request processed in 46us (14071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592716.618563:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788592716.619207:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4c000 x1875475225980160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592716.619220:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475225980160:0@lo:400:kworker.0 00010000:00010000:0.0:1788592716.733263:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592717.114253:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592717.114275:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225980416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592717.114356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592717.114400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980416 00000100:00100000:2.0:1788592717.114409:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980416 00000100:00100000:2.0:1788592717.114457:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592717.114465:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225980416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592717.114489:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592717.114533:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225980416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592717.114540:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788592717.114695:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437bd500 x1875475225980416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592717.114724:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225980416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592717.629392:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225980672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592717.629493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592717.629585:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592717.629603:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225980544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592717.629629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592717.629674:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980672 00000100:00100000:0.0:1788592717.629682:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980672 00000100:00100000:0.0:1788592717.629738:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980544 00000100:00100000:0.0:1788592717.629742:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980544 00000100:00100000:0.0:1788592717.629758:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592717.629767:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225980672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592717.629799:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592717.630118:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225980672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 350us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592717.630138:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592717.630156:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788592717.630163:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225980544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592717.630175:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592717.630201:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225980544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592717.630207:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788592717.630248:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bd180 x1875475225980544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592717.630267:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225980544:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788592717.630279:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218767bfb80 x1875475225980672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592717.630292:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225980672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788592717.753845:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592718.778307:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592719.296348:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592719.297433:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592719.297479:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592719.297589:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135360 00000100:00100000:0.0:1788592719.297589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135616 00000100:00100000:1.0:1788592719.297599:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135360 00000100:00100000:0.0:1788592719.297599:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135616 00000100:00100000:0.0:1788592719.297653:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135488 00000100:00100000:0.0:1788592719.297657:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135488 00000100:00100000:0.0:1788592719.297679:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:0.0:1788592719.297690:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209135616:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592719.297745:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 281 00000100:00100000:0.0:1788592719.297762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209135616:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592719.297769:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:0.0:1788592719.297787:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:0.0:1788592719.297793:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209135488:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592719.297818:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209135488:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592719.297823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:1.0:1788592719.297825:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2393:x1875475209135360:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592719.297864:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+10:2393:x1875475209135360:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 112us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592719.297871:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 281 00000100:00080000:3.0:1788592719.298038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592719.298043:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592719.672461:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592719.672484:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225980800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592719.672583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592719.672953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980800 00000100:00100000:1.0:1788592719.672973:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980800 00000100:00100000:1.0:1788592719.673018:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788592719.673027:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225980800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592719.673059:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788592719.676219:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592719.676241:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225980928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592719.681295:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225980800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8260us (8703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592719.681322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592719.682538:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225980800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592719.686316:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592719.686667:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225980928 00000100:00100000:1.0:1788592719.686681:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225980928 00000100:00100000:1.0:1788592719.686731:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592719.686741:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225980928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592719.686785:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788592719.686874:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225980928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592719.686881:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788592719.686995:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225980928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788592719.800638:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592720.825207:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592721.720449:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225981056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592721.720555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592721.720626:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981056 00000100:00100000:0.0:1788592721.720634:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981056 00000100:00080000:1.0:1788592721.720729:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592721.720754:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225981184:0@lo:400:kworker.0 00000100:00100000:0.0:1788592721.720773:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592721.720784:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225981056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592721.720811:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788592721.720825:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592721.720873:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225981056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592721.720879:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592721.721812:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981184 00000100:00100000:0.0:1788592721.721818:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981184 00000100:00100000:0.0:1788592721.721860:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788592721.721871:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225981184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.721875:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225981568:0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.721890:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225981312:0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.721921:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592721.721931:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225981184:12345-0@lo:400:kworker.0 Request processed in 62us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592721.721941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592721.721942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788592721.722004:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225981440:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.722180:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225981184:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.722205:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225981696:0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.722400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592721.722416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592721.722427:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475225981952:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.722449:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225982208:0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.722460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592721.722486:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475225982464:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.722488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592721.722509:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225982080:0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.722524:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592721.722547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592721.722554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981568 00000100:00100000:1.0:1788592721.722560:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981568 00000100:00100000:3.0:1788592721.722569:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981440 00000100:00100000:0.0:1788592721.722574:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225982592:0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.722575:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981440 00000100:00100000:1.0:1788592721.722597:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788592721.722603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592721.722621:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225981568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.722626:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788592721.722635:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437bc000 x1875475225981056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592721.722647:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225981440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592721.722655:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225981056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592721.722674:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225981568:12345-0@lo:400:kworker.0 Request processed in 67us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592721.722683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788592721.722702:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225981440:12345-0@lo:400:kworker.0 Request processed in 66us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592721.722709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788592721.722732:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981312 00000100:00100000:3.0:1788592721.722735:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981312 00000100:00100000:1.0:1788592721.722741:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981696 00000100:00100000:3.0:1788592721.722754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981952 00000100:00100000:1.0:1788592721.722757:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981696 00000100:00100000:3.0:1788592721.722759:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981952 00000100:00100000:3.0:1788592721.722781:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982464 00000100:00100000:3.0:1788592721.722783:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982464 00000100:00100000:1.0:1788592721.722801:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592721.722808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788592721.722812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225981312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.722829:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475225981952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.722852:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225981312:12345-0@lo:400:kworker.0 Request processed in 43us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592721.722860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592721.722874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475225981952:12345-0@lo:400:kworker.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592721.722880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788592721.722888:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225981696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.722922:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225981696:12345-0@lo:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592721.723443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788592721.723462:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788592721.723469:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475225982464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592721.723504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475225982464:12345-0@lo:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592721.723510:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788592721.723965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788592721.724165:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225981568:0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225981312:0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724199:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225981824:0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592721.724267:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225982336:0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592721.724324:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225981824 00000100:00100000:2.0:1788592721.724329:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225981824 00000100:00100000:2.0:1788592721.724356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982336 00000100:00100000:2.0:1788592721.724359:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982336 00000100:00100000:2.0:1788592721.724374:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788592721.724380:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225981824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225981824:12345-0@lo:400:kworker.0 Request processed in 40us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592721.724427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788592721.724440:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788592721.724447:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225982336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724474:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225982336:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592721.724480:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788592721.724508:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225981824:0@lo:400:kworker.0 00000100:00100000:2.0:1788592721.724552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225982336:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.724674:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982208 00000100:00100000:1.0:1788592721.724679:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982208 00000100:00100000:1.0:1788592721.724713:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982080 00000100:00100000:1.0:1788592721.724717:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982080 00000100:00100000:1.0:1788592721.724737:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982592 00000100:00100000:1.0:1788592721.724739:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982592 00000100:00100000:1.0:1788592721.724757:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788592721.724765:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225982208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592721.724778:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592721.724789:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225982080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.724807:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225982208:12345-0@lo:400:kworker.0 Request processed in 42us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592721.724814:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788592721.724829:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788592721.724837:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225982592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592721.724841:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225982080:12345-0@lo:400:kworker.0 Request processed in 53us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592721.724850:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788592721.724877:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225982592:12345-0@lo:400:kworker.0 Request processed in 40us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592721.724884:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788592721.724898:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f532300 x1875475225982080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592721.724912:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225982080:0@lo:400:kworker.0 00010000:00080000:0.0:1788592721.724926:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f532a00 x1875475225982592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592721.724935:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225982592:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.724943:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225981696:0@lo:400:kworker.0 00010000:00080000:1.0:1788592721.724959:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f533100 x1875475225982208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788592721.725000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592721.725005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592721.725007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592721.725009:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592721.725032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225981440:0@lo:400:kworker.0 00010000:00080000:3.0:1788592721.725045:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f530380 x1875475225981952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592721.725054:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475225981952:0@lo:400:kworker.0 00010000:00080000:3.0:1788592721.725081:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f532680 x1875475225982464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592721.725091:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475225982464:0@lo:400:kworker.0 00000100:00100000:1.0:1788592721.725292:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225982208:0@lo:400:kworker.0 00010000:00010000:0.0:1788592721.849222:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592722.232550:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225982720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592722.232622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592722.233540:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982720 00000100:00100000:2.0:1788592722.233554:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982720 00000100:00100000:2.0:1788592722.233656:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788592722.233748:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225982720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592722.233776:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592722.233899:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225982720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592722.233906:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788592722.234118:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f531180 x1875475225982720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592722.234226:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225982720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592722.744324:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592722.744429:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225982848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592722.744497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592722.744543:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982848 00000100:00100000:3.0:1788592722.744552:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982848 00000100:00100000:3.0:1788592722.744593:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592722.744601:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225982848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592722.744629:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592722.744672:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225982848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592722.744679:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788592722.744718:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b8e300 x1875475225982848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592722.744735:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225982848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592722.745238:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225982976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592722.745271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592722.745978:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225982976 00000100:00100000:2.0:1788592722.745986:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225982976 00000100:00100000:2.0:1788592722.746177:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592722.746187:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225982976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788592722.746207:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592722.746454:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225982976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 269us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592722.746460:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788592722.746463:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4ed80 x1875475225982976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592722.746480:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225982976:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788592722.872988:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592723.899616:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592724.408855:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592724.408913:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592724.408943:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592724.408964:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136000 00000100:00100000:0.0:1788592724.408964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135872 00000100:00100000:3.0:1788592724.408972:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136000 00000100:00100000:0.0:1788592724.408972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135872 00000100:00100000:1.0:1788592724.409029:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209135744 00000100:00100000:1.0:1788592724.409035:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209135744 00000100:00100000:1.0:1788592724.409100:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 283 00000100:00100000:1.0:1788592724.409109:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2393:x1875475209135744:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592724.409120:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 104 00000100:00100000:3.0:1788592724.409128:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209136000:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592724.409515:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209136000:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 386us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592724.409529:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 104 00000100:00100000:1.0:1788592724.411158:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2393:x1875475209135744:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 2041us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592724.411173:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 283 00000100:00080000:3.0:1788592724.411461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592724.411468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592724.412166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:0.0:1788592724.412179:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209135872:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592724.412431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209135872:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 254us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592724.412440:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:2.0:1788592724.792412:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225983104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592724.792525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592724.792674:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983104 00000100:00100000:0.0:1788592724.792682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983104 00000100:00100000:0.0:1788592724.792735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788592724.792745:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225983104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592724.792778:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592724.792845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225983104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592724.792853:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788592724.792902:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225983104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592724.796276:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592724.796300:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225983232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592724.796397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592724.796491:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983232 00000100:00100000:1.0:1788592724.796499:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983232 00000100:00100000:1.0:1788592724.796537:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788592724.796543:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225983232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592724.796580:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788592724.796634:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225983232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592724.796641:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788592724.796737:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225983232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788592724.924259:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592725.945478:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592726.841441:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225983360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592726.841547:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.844195:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983360 00000100:00100000:3.0:1788592726.845985:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983360 00000100:00100000:3.0:1788592726.846112:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592726.846123:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225983360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592726.846156:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592726.848152:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225983360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2022us (6595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.848165:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788592726.848202:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788592726.851347:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b50700 x1875475225983360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592726.851374:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225983360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592726.853028:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225983744:0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.853127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.853177:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475225984256:0@lo:400:kworker.0 00000100:00100000:2.0:1788592726.853605:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225983616:0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.854777:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.854821:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475225984768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855462:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225983488:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592726.855543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225984000:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592726.855584:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225984512:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592726.855640:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788592726.855646:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225983872:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592726.855682:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225984384:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855698:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592726.855712:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225984896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.855729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592726.855826:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983488 00000100:00100000:0.0:1788592726.855834:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983488 00000100:00100000:3.0:1788592726.856336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.856378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983744 00000100:00100000:3.0:1788592726.856382:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983744 00000100:00100000:3.0:1788592726.856418:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983872 00000100:00100000:3.0:1788592726.856421:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983872 00000100:00100000:3.0:1788592726.856436:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788592726.856443:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225983744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856495:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225983744:12345-0@lo:400:kworker.0 Request processed in 52us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.856511:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788592726.856528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788592726.856534:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225983872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856568:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225983872:12345-0@lo:400:kworker.0 Request processed in 35us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.856573:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788592726.856589:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984256 00000100:00100000:3.0:1788592726.856593:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984256 00000100:00100000:3.0:1788592726.856619:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984000 00000100:00100000:3.0:1788592726.856622:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984000 00000100:00100000:3.0:1788592726.856630:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984768 00000100:00100000:3.0:1788592726.856632:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984768 00000100:00100000:3.0:1788592726.856643:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788592726.856649:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475225984256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856690:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475225984256:12345-0@lo:400:kworker.0 Request processed in 41us (3487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.856695:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788592726.856707:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788592726.856712:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225984000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856734:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475225984000:12345-0@lo:400:kworker.0 Request processed in 23us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.856740:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788592726.856748:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788592726.856753:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475225984768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856775:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475225984768:12345-0@lo:400:kworker.0 Request processed in 22us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.856789:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788592726.856807:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.856829:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225984128:0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.856863:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225984640:0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856878:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592726.856897:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225983616 00000100:00100000:3.0:1788592726.856900:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225983616 00000100:00100000:3.0:1788592726.856913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984128 00000100:00100000:3.0:1788592726.856916:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984128 00000100:00100000:3.0:1788592726.856926:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984640 00000100:00100000:3.0:1788592726.856928:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984640 00000100:00100000:3.0:1788592726.856941:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788592726.856946:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225983616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.856978:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225983616:12345-0@lo:400:kworker.0 Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.856984:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788592726.856996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788592726.857001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225984128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.857025:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225984128:12345-0@lo:400:kworker.0 Request processed in 25us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.857030:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788592726.857039:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788592726.857044:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225984640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.857103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225984640:12345-0@lo:400:kworker.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592726.857118:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788592726.857134:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592726.857138:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592726.857166:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225983616:0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.857177:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225984128:0@lo:400:kworker.0 00000100:00100000:3.0:1788592726.857185:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225984640:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.858644:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788592726.858658:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225983488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.858724:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225983488:12345-0@lo:400:kworker.0 Request processed in 70us (3212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592726.858731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788592726.858772:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984512 00000100:00100000:0.0:1788592726.858786:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984512 00000100:00100000:0.0:1788592726.858823:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984384 00000100:00100000:0.0:1788592726.858826:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984384 00000100:00100000:0.0:1788592726.858954:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225984896 00000100:00100000:0.0:1788592726.858958:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225984896 00000100:00100000:0.0:1788592726.858977:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592726.858982:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225984512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.859093:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225984512:12345-0@lo:400:kworker.0 Request processed in 110us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592726.859099:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592726.859112:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788592726.859118:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225984384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.859146:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225984384:12345-0@lo:400:kworker.0 Request processed in 29us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592726.859151:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788592726.859161:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788592726.859167:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225984896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.859191:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225984896:12345-0@lo:400:kworker.0 Request processed in 26us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592726.859197:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592726.859492:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225983744:0@lo:400:kworker.0 00010000:00080000:3.0:1788592726.859510:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b6680 x1875475225984256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592726.859521:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475225984256:0@lo:400:kworker.0 00010000:00080000:3.0:1788592726.859533:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f484380 x1875475225984768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592726.859542:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475225984768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.859983:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225983872:0@lo:400:kworker.0 00010000:00080000:0.0:1788592726.859997:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741ddb100 x1875475225984384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592726.860006:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225984384:0@lo:400:kworker.0 00010000:00080000:0.0:1788592726.860017:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f487100 x1875475225984896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592726.860038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225984896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.860050:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225983488:0@lo:400:kworker.0 00000100:00100000:0.0:1788592726.860782:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475225984000:0@lo:400:kworker.0 00010000:00080000:0.0:1788592726.860800:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741dd8a80 x1875475225984512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592726.860809:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225984512:0@lo:400:kworker.0 00000100:00080000:0.0:1788592726.860935:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592726.860940:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788592726.970029:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592727.353199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225985024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592727.353271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592727.353397:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985024 00000100:00100000:2.0:1788592727.353406:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985024 00000100:00100000:2.0:1788592727.353473:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592727.353485:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225985024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592727.353520:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592727.353579:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225985024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592727.353587:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788592727.353637:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f530e00 x1875475225985024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592727.353657:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225985024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592727.864280:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592727.864302:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225985152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592727.864369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592727.864416:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985152 00000100:00100000:3.0:1788592727.864423:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985152 00000100:00100000:3.0:1788592727.864468:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788592727.864476:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225985152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592727.864645:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592727.864700:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225985152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592727.864719:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788592727.864744:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f487100 x1875475225985152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592727.864763:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225985152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592727.865359:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225985280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592727.865395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592727.866089:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985280 00000100:00100000:3.0:1788592727.866097:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985280 00000100:00100000:3.0:1788592727.866142:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788592727.866151:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225985280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788592727.866185:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592727.866241:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225985280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592727.866248:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788592727.866598:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f487100 x1875475225985280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592727.866618:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225985280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788592727.995804:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592728.552974:0:11987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:18:47 (1788592727) === 00000100:00100000:3.0:1788592728.878962:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.883801:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136128 00000100:00100000:1.0:1788592728.883822:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136128 00000100:00100000:1.0:1788592728.883959:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 285 00000100:00100000:1.0:1788592728.883971:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+10:8718:x1875475209136128:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788592728.883993:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592728.884025:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839e00/0xbd314a3362db4dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2cbe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592728.884085:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839e00/0xbd314a3362db4dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cbe expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592728.884098:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839e00/0xbd314a3362db4dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cbe expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592728.884109:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839e00, rc 0) 00000100:00100000:1.0:1788592728.884198:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:8718:x1875475209136128:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 228us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.884205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 285 00000100:00100000:3.0:1788592728.886963:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592728.887221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136256 00000100:00100000:0.0:1788592728.887234:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136256 00000100:00100000:0.0:1788592728.887300:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 286 00000100:00100000:0.0:1788592728.887310:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+11:8718:x1875475209136256:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788592728.887500:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+11:8718:x1875475209136256:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 191us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592728.887532:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 286 00000100:00100000:3.0:1788592728.891436:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.891509:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136384 00000100:00100000:1.0:1788592728.891523:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136384 00000100:00100000:1.0:1788592728.891658:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 287 00000100:00100000:1.0:1788592728.891672:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:8718:x1875475209136384:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788592728.891873:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:8718:x1875475209136384:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 204us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.891892:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 287 00000100:00100000:3.0:1788592728.911687:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.912140:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136512 00000100:00100000:1.0:1788592728.912155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136512 00000100:00100000:1.0:1788592728.912248:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 288 00000100:00100000:1.0:1788592728.912261:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+11:8722:x1875475209136512:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592728.912482:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+11:8722:x1875475209136512:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 219us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.912492:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 288 00000100:00100000:3.0:1788592728.945605:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.946278:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136640 00000100:00100000:1.0:1788592728.946289:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136640 00000100:00100000:1.0:1788592728.946484:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 289 00000100:00100000:1.0:1788592728.946508:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:8722:x1875475209136640:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592728.946689:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:8722:x1875475209136640:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 185us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.946698:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 289 00000100:00100000:2.0:1788592728.948782:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592728.949383:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136768 00000100:00100000:0.0:1788592728.949393:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136768 00000100:00100000:0.0:1788592728.949441:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 290 00000100:00100000:0.0:1788592728.949451:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+11:8722:x1875475209136768:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592728.949815:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+11:8722:x1875475209136768:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 365us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592728.949824:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 290 00000100:00100000:3.0:1788592728.952918:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.953104:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209136896 00000100:00100000:1.0:1788592728.953114:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209136896 00000100:00100000:1.0:1788592728.953157:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 291 00000100:00100000:1.0:1788592728.953178:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:8718:x1875475209136896:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788592728.953194:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592728.953212:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839800/0xbd314a3362db4df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592728.953242:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839800/0xbd314a3362db4df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cef expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592728.953270:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839800/0xbd314a3362db4df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cef expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592728.953281:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839800, rc 0) 00000100:00100000:1.0:1788592728.953346:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:8718:x1875475209136896:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 180us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.953352:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 291 00000100:00100000:3.0:1788592728.961172:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.961387:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137024 00000100:00100000:1.0:1788592728.961397:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137024 00000100:00100000:1.0:1788592728.961459:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 292 00000100:00100000:1.0:1788592728.961468:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:8718:x1875475209137024:12345-192.168.203.47@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788592728.961494:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788592728.961517:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788592728.961521:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788592728.961524:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788592728.961527:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788592728.961530:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788592728.964872:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:8718:x1875475209137024:12345-192.168.203.47@tcp:256:mount.lustre.0 Request processed in 3394us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.964885:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 292 00000100:00100000:3.0:1788592728.970605:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592728.970678:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137152 00000100:00100000:2.0:1788592728.970689:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137152 00000100:00100000:2.0:1788592728.970794:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 293 00000100:00100000:2.0:1788592728.970806:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+12:8718:x1875475209137152:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592728.970823:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592728.970840:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2cf6 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592728.970868:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592728.970879:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592728.970889:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80200, rc 0) 00000100:00100000:2.0:1788592728.970963:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:8718:x1875475209137152:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 159us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592728.970992:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 293 00000100:00100000:3.0:1788592728.974946:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592728.976355:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137280 00000100:00100000:1.0:1788592728.976369:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137280 00000100:00100000:1.0:1788592728.976437:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 294 00000100:00100000:1.0:1788592728.976447:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:8718:x1875475209137280:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592728.976649:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:8718:x1875475209137280:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 203us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.976674:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 294 00000100:00100000:1.0:1788592728.979896:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592728.982235:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137408 00000100:00100000:2.0:1788592728.982250:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137408 00000100:00100000:2.0:1788592728.982318:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 295 00000100:00100000:2.0:1788592728.982328:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:8718:x1875475209137408:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788592728.982488:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:8718:x1875475209137408:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 161us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592728.982497:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 295 00000100:00100000:3.0:1788592728.991635:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592728.993083:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137536 00000100:00100000:0.0:1788592728.993096:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137536 00000100:00100000:0.0:1788592728.993284:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 296 00000100:00100000:0.0:1788592728.993296:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:8728:x1875475209137536:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592728.993463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:8728:x1875475209137536:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 169us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592728.993472:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 296 00000100:00100000:3.0:1788592728.997151:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592728.997298:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137664 00000100:00100000:2.0:1788592728.997308:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137664 00000100:00100000:2.0:1788592728.997372:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 297 00000100:00100000:2.0:1788592728.997382:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:8728:x1875475209137664:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592728.997535:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:8728:x1875475209137664:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 152us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592728.997543:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 297 00000100:00100000:2.0:1788592729.002292:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592729.002344:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592729.002990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137792 00000100:00100000:0.0:1788592729.002999:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137792 00000100:00100000:0.0:1788592729.003041:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138048 00000100:00100000:0.0:1788592729.003052:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138048 00000100:00100000:0.0:1788592729.003105:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:0.0:1788592729.003112:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875475209137792:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788592729.003151:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9ab9d447-3b18-4e16-9fd8-b554c1995bd0@192.168.203.47@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1788592729.003186:0:6512:0:(genops.c:1385:class_connect()) connect: client 9ab9d447-3b18-4e16-9fd8-b554c1995bd0, cookie 0xbd314a3362db4e03 00000004:00100000:0.0:1788592729.003210:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788592729.003320:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9217438b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592729.003547:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:2.0:1788592729.003553:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875475209138048:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788592729.003571:0:10029:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9ab9d447-3b18-4e16-9fd8-b554c1995bd0@192.168.203.47@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1788592729.003594:0:10029:0:(genops.c:1385:class_connect()) connect: client 9ab9d447-3b18-4e16-9fd8-b554c1995bd0, cookie 0xbd314a3362db4e0a 00000004:00100000:2.0:1788592729.003607:0:10029:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788592729.003665:0:10029:0:(import.c:65:import_set_state_nolock()) ffff9218767b6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592729.004244:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2392:x1875475209137792:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 1129us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592729.004254:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:3.0:1788592729.004375:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592729.004584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138560 00000100:00100000:0.0:1788592729.004590:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138560 00000100:00100000:0.0:1788592729.004639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 112 00000100:00100000:0.0:1788592729.004654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209138560:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592729.004688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209138560:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 36us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592729.004693:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 112 00000100:00080000:0.0:1788592729.004708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592729.005005:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592729.005453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138432 00000100:00100000:0.0:1788592729.005459:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138432 00000100:00100000:0.0:1788592729.005505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 113 00000100:00100000:0.0:1788592729.005513:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209138432:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592729.005556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209138432:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 43us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592729.005563:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 113 00000100:00080000:3.0:1788592729.005636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592729.006429:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2392:x1875475209138048:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 2869us (4079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592729.006452:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:3.0:1788592729.014536:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592729.014583:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592729.015142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138176 00000100:00100000:2.0:1788592729.015153:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138176 00000100:00080000:3.0:1788592729.015320:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592729.016643:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592729.019028:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209137920 00000100:00100000:0.0:1788592729.019051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209137920 00000100:00100000:2.0:1788592729.019165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:2.0:1788592729.019180:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:0:x1875475209138176:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788592729.019221:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592729.019796:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:0:x1875475209138176:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 617us (5265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592729.019804:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:0.0:1788592729.019868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:0.0:1788592729.019877:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:0:x1875475209137920:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788592729.019898:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592729.019950:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:0:x1875475209137920:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 75us (5367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592729.019958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00080000:2.0:1788592729.020435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788592729.020647:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592729.021663:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138304 00000100:00100000:1.0:1788592729.021673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138304 00000100:00100000:1.0:1788592729.021731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:1.0:1788592729.021740:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+7:8718:x1875475209138304:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788592729.021763:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592729.021823:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+7:8718:x1875475209138304:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 84us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592729.021831:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:1.0:1788592729.026933:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592729.027285:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138688 00000100:00100000:2.0:1788592729.027294:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138688 00000100:00100000:2.0:1788592729.027379:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:2.0:1788592729.027390:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:8718:x1875475209138688:12345-192.168.203.47@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788592729.027477:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:8718:x1875475209138688:12345-192.168.203.47@tcp:40:mount.lustre.0 Request processed in 88us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592729.027484:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:3.0:1788592729.030628:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592729.031868:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138816 00000100:00100000:0.0:1788592729.031882:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138816 00000100:00100000:0.0:1788592729.031978:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:0.0:1788592729.031987:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875475209138816:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788592729.032020:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9ab9d447-3b18-4e16-9fd8-b554c1995bd0@192.168.203.47@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1788592729.032091:0:8429:0:(genops.c:1385:class_connect()) connect: client 9ab9d447-3b18-4e16-9fd8-b554c1995bd0, cookie 0xbd314a3362db4e11 00002000:00100000:0.0:1788592729.032104:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9ab9d447-3b18-4e16-9fd8-b554c1995bd0/ffff9217438b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788592729.032115:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788592729.032234:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788592729.032275:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9217438b3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592729.032347:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2392:x1875475209138816:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 359us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592729.032355:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:3.0:1788592729.037192:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592729.037234:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592729.037355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139072 00000100:00100000:1.0:1788592729.037365:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139072 00000100:00100000:1.0:1788592729.037430:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:1.0:1788592729.037440:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:8718:x1875475209139072:12345-192.168.203.47@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788592729.037524:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:8718:x1875475209139072:12345-192.168.203.47@tcp:900:mount.lustre.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592729.037532:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:0.0:1788592729.037708:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209138944 00000100:00100000:0.0:1788592729.037713:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209138944 00000100:00100000:0.0:1788592729.037897:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:0.0:1788592729.037903:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875475209138944:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788592729.037931:0:8590:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9ab9d447-3b18-4e16-9fd8-b554c1995bd0@192.168.203.47@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1788592729.037961:0:8590:0:(genops.c:1385:class_connect()) connect: client 9ab9d447-3b18-4e16-9fd8-b554c1995bd0, cookie 0xbd314a3362db4e18 00002000:00100000:0.0:1788592729.037980:0:8590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9ab9d447-3b18-4e16-9fd8-b554c1995bd0/ffff9217438b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788592729.037998:0:8590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788592729.038119:0:8590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788592729.038146:0:8590:0:(import.c:65:import_set_state_nolock()) ffff9217438b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592729.038176:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2392:x1875475209138944:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 272us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592729.038200:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:3.0:1788592729.042737:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592729.042820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139200 00000100:00100000:2.0:1788592729.042833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139200 00000100:00100000:2.0:1788592729.042907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:2.0:1788592729.042918:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:8718:x1875475209139200:12345-192.168.203.47@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788592729.043008:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788592729.043160:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:8718:x1875475209139200:12345-192.168.203.47@tcp:33:mount.lustre.0 Request processed in 240us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592729.043192:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:2.0:1788592729.912231:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592729.912265:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225985408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592729.912371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592729.912460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985408 00000100:00100000:2.0:1788592729.912470:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985408 00000100:00100000:2.0:1788592729.912551:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592729.912562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225985408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592729.912827:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592729.913428:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225985408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 863us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592729.913439:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788592729.913509:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225985408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592729.915642:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225985536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592729.915729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592729.917322:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985536 00000100:00100000:1.0:1788592729.917340:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985536 00000100:00100000:1.0:1788592729.917412:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788592729.917424:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225985536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592729.917470:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592729.917567:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225985536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592729.917597:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788592729.917633:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225985536:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592730.040218:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592731.065255:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592731.960526:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475225985792:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960587:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960630:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475225986304:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960673:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225986816:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960718:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788592731.960724:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225985664:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960749:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960768:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225986176:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960785:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960799:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225986688:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960834:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225987200:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960888:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225985920:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960912:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960929:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225986432:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960946:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960955:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225986944:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.960970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.960981:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788592731.960985:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225986048:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961000:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.961013:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225986560:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.961059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225987072:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961110:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592731.961142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985792 00000100:00100000:2.0:1788592731.961149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985792 00000100:00100000:2.0:1788592731.961185:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986304 00000100:00100000:2.0:1788592731.961187:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986304 00000100:00100000:2.0:1788592731.961210:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986816 00000100:00100000:2.0:1788592731.961213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986816 00000100:00100000:2.0:1788592731.961227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986176 00000100:00100000:2.0:1788592731.961229:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986176 00000100:00100000:2.0:1788592731.961240:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986432 00000100:00100000:2.0:1788592731.961242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986432 00000100:00100000:2.0:1788592731.961255:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986944 00000100:00100000:2.0:1788592731.961258:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986944 00000100:00100000:2.0:1788592731.961276:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788592731.961285:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475225985792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961332:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475225985792:12345-0@lo:400:kworker.0 Request processed in 48us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788592731.961360:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788592731.961366:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475225986304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475225986304:12345-0@lo:400:kworker.0 Request processed in 28us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788592731.961410:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788592731.961415:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225986816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961440:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225986816:12345-0@lo:400:kworker.0 Request processed in 25us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961445:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788592731.961457:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788592731.961463:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225986176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961485:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225986176:12345-0@lo:400:kworker.0 Request processed in 22us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961491:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788592731.961500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788592731.961505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225986432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961531:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225986432:12345-0@lo:400:kworker.0 Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788592731.961546:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788592731.961552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225986944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961574:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225986944:12345-0@lo:400:kworker.0 Request processed in 22us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788592731.961607:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985664 00000100:00100000:2.0:1788592731.961611:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985664 00000100:00100000:2.0:1788592731.961632:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788592731.961637:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225985664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961665:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225985664:12345-0@lo:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961671:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788592731.961698:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986688 00000100:00100000:2.0:1788592731.961702:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986688 00000100:00100000:2.0:1788592731.961723:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987200 00000100:00100000:2.0:1788592731.961726:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987200 00000100:00100000:2.0:1788592731.961736:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986560 00000100:00100000:2.0:1788592731.961738:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986560 00000100:00100000:2.0:1788592731.961747:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987072 00000100:00100000:2.0:1788592731.961749:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987072 00000100:00100000:2.0:1788592731.961761:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592731.961766:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225986688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961793:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225986688:12345-0@lo:400:kworker.0 Request processed in 26us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961799:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592731.961809:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592731.961816:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225987200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961844:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225987200:12345-0@lo:400:kworker.0 Request processed in 30us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961850:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592731.961862:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592731.961877:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225986560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961907:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225986560:12345-0@lo:400:kworker.0 Request processed in 32us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961912:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592731.961923:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592731.961930:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225987072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.961954:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225987072:12345-0@lo:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.961960:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592731.961979:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225985920 00000100:00100000:2.0:1788592731.961983:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225985920 00000100:00100000:2.0:1788592731.962004:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225986048 00000100:00100000:2.0:1788592731.962007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225986048 00000100:00100000:2.0:1788592731.962019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788592731.962040:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225985920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962093:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225985920:12345-0@lo:400:kworker.0 Request processed in 68us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.962099:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788592731.962111:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788592731.962116:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225986048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962321:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225986048:12345-0@lo:400:kworker.0 Request processed in 204us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592731.962328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788592731.962357:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592731.962361:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592731.962364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592731.962366:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592731.962414:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225986048:0@lo:400:kworker.0 00010000:00080000:2.0:1788592731.962430:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f530380 x1875475225986560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592731.962441:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225986560:0@lo:400:kworker.0 00010000:00080000:2.0:1788592731.962452:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d0e00 x1875475225987072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592731.962461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225987072:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962470:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225985920:0@lo:400:kworker.0 00010000:00080000:2.0:1788592731.962480:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f532680 x1875475225986432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592731.962487:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225986432:0@lo:400:kworker.0 00010000:00080000:2.0:1788592731.962497:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d1f80 x1875475225986944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592731.962505:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225986944:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962549:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225985664:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962562:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225986176:0@lo:400:kworker.0 00010000:00080000:2.0:1788592731.962574:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f532a00 x1875475225986688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592731.962681:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225986688:0@lo:400:kworker.0 00010000:00080000:2.0:1788592731.962693:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d1500 x1875475225987200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592731.962715:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225987200:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962729:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475225985792:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962739:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475225986304:0@lo:400:kworker.0 00000100:00100000:2.0:1788592731.962749:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225986816:0@lo:400:kworker.0 00000100:00100000:1.0:1788592731.963484:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592731.963501:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225987328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592731.963548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592731.963583:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987328 00000100:00100000:1.0:1788592731.963588:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987328 00000100:00100000:1.0:1788592731.963626:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788592731.963633:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225987328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592731.963655:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592731.963691:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225987328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592731.963696:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788592731.963727:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b53b80 x1875475225987328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592731.963741:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225987328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788592732.089468:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592732.474485:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225987456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592732.474551:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592732.474641:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987456 00000100:00100000:2.0:1788592732.474648:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987456 00000100:00100000:2.0:1788592732.474702:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788592732.474711:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225987456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592732.474731:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592732.474773:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225987456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592732.474779:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788592732.474893:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d1500 x1875475225987456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592732.474910:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225987456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592732.984394:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592732.984428:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225987584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592732.984510:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592732.984822:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987584 00000100:00100000:3.0:1788592732.984830:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987584 00000100:00100000:3.0:1788592732.984886:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788592732.984896:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225987584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592732.984923:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592732.984980:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225987584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592732.984987:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788592732.985097:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b7100 x1875475225987584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592732.985117:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225987584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592732.987623:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225987712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592732.987705:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592732.987795:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987712 00000100:00100000:2.0:1788592732.987803:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987712 00000100:00100000:2.0:1788592732.987858:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592732.987868:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225987712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788592732.987887:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592732.989202:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225987712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1330us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592732.989215:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788592732.991665:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b7100 x1875475225987712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592732.991712:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225987712:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788592733.113204:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592734.149716:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592734.152915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.152958:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.152978:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.153000:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.153033:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.153052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.153102:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592734.153131:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139328 00000100:00100000:3.0:1788592734.153141:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139328 00000100:00100000:3.0:1788592734.153190:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 299 00000100:00100000:3.0:1788592734.153199:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209139328:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153265:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209139328:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 299 00000100:00100000:3.0:1788592734.153303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139456 00000100:00100000:3.0:1788592734.153307:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139456 00000100:00100000:3.0:1788592734.153335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139712 00000100:00100000:3.0:1788592734.153338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139712 00000100:00100000:3.0:1788592734.153350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139584 00000100:00100000:3.0:1788592734.153353:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139584 00000100:00100000:3.0:1788592734.153363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139840 00000100:00100000:3.0:1788592734.153365:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139840 00000100:00100000:3.0:1788592734.153379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 120 00000100:00100000:3.0:1788592734.153385:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209139456:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209139456:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 120 00000100:00100000:3.0:1788592734.153433:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:3.0:1788592734.153440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2395:x1875475209139712:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153471:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2395:x1875475209139712:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153477:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:3.0:1788592734.153489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:3.0:1788592734.153495:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209139584:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209139584:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 22us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153522:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:3.0:1788592734.153533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00100000:3.0:1788592734.153539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2396:x1875475209139840:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153559:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2396:x1875475209139840:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 20us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00100000:3.0:1788592734.153581:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209139968 00000100:00100000:3.0:1788592734.153584:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209139968 00000100:00100000:3.0:1788592734.153606:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140096 00000100:00100000:3.0:1788592734.153608:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140096 00000100:00100000:3.0:1788592734.153625:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:3.0:1788592734.153630:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2395:x1875475209139968:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153652:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2395:x1875475209139968:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153658:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:3.0:1788592734.153668:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:3.0:1788592734.153674:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2396:x1875475209140096:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592734.153702:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2396:x1875475209140096:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.153708:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00080000:3.0:1788592734.153829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592734.153833:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592734.153836:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592734.153838:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788592734.196811:0:12180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1788592734.528670:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00100000:1.0:1788592734.529551:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00100000:2.0:1788592734.530707:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00100000:0.0:1788592734.535702:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000100:00100000:2.0:1788592735.032301:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592735.032322:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225987840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592735.032400:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592735.032507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987840 00000100:00100000:1.0:1788592735.032515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987840 00000100:00100000:1.0:1788592735.032575:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788592735.032584:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225987840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592735.032619:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592735.032666:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225987840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592735.032672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788592735.033032:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225987840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592735.033180:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225987968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592735.033216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592735.033252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225987968 00000100:00100000:2.0:1788592735.033257:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225987968 00000100:00100000:2.0:1788592735.033292:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788592735.033299:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225987968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592735.033319:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592735.033364:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225987968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592735.033371:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592735.033445:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225987968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788592735.160385:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592736.188306:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592737.085881:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225988096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592737.085951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.086033:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988096 00000100:00100000:2.0:1788592737.086041:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988096 00000100:00100000:2.0:1788592737.086124:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788592737.086135:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225988096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592737.086180:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592737.086227:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225988096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.086234:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788592737.086277:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d1f80 x1875475225988096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592737.086294:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225988096:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788592737.086322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592737.086682:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225988224:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.086719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.086901:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225988736:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.086926:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.086943:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788592737.086949:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225988352:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.086973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.086999:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225988864:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087023:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.087062:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225988480:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.087125:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592737.087130:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225988608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.087213:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988480 00000100:00100000:2.0:1788592737.087218:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988480 00000100:00100000:2.0:1788592737.087243:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988608 00000100:00100000:2.0:1788592737.087246:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988608 00000100:00100000:2.0:1788592737.087257:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788592737.087262:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844eb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225988480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087302:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844eb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225988480:12345-0@lo:400:kworker.0 Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.087308:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788592737.087558:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788592737.087564:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225988608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087597:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225988608:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.087609:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788592737.087648:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225988608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087658:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225988480:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988736 00000100:00100000:2.0:1788592737.087698:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988736 00000100:00100000:2.0:1788592737.087724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988352 00000100:00100000:2.0:1788592737.087727:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988352 00000100:00100000:2.0:1788592737.087737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988864 00000100:00100000:2.0:1788592737.087739:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988864 00000100:00100000:2.0:1788592737.087756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788592737.087762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225988736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.087796:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225988736:12345-0@lo:400:kworker.0 Request processed in 35us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.087802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788592737.087813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788592737.088413:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225988352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.088451:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225988352:12345-0@lo:400:kworker.0 Request processed in 633us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.088458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788592737.088472:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788592737.088478:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225988864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.088505:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225988864:12345-0@lo:400:kworker.0 Request processed in 28us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.088511:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788592737.088530:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592737.088566:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225988352:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.088576:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225988864:0@lo:400:kworker.0 00000100:00100000:2.0:1788592737.088584:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225988736:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.088764:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225989376:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.088811:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.088849:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592737.088855:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225989248:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.088879:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.088906:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989248 00000100:00100000:3.0:1788592737.088910:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989248 00000100:00100000:3.0:1788592737.088945:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592737.088952:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225989248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.088984:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225989248:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.088998:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788592737.089028:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b20e00 x1875475225989248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592737.089039:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225989248:0@lo:400:kworker.0 00000100:00080000:3.0:1788592737.089054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592737.089061:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225989120:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.089131:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225989632:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.089541:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788592737.089552:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475225988992:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.089599:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475225989504:0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.089643:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989120 00000100:00100000:3.0:1788592737.089647:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989120 00000100:00100000:3.0:1788592737.089677:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989632 00000100:00100000:3.0:1788592737.089679:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989632 00000100:00100000:3.0:1788592737.089697:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788592737.089703:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225989120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089736:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225989120:12345-0@lo:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.089742:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788592737.089754:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592737.089759:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225989632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089783:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225989632:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.089789:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592737.089812:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989376 00000100:00100000:3.0:1788592737.089878:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989376 00000100:00100000:3.0:1788592737.089904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988992 00000100:00100000:3.0:1788592737.089907:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988992 00000100:00100000:3.0:1788592737.089917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989504 00000100:00100000:3.0:1788592737.089918:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989504 00000100:00100000:3.0:1788592737.089931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788592737.089945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225989376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.089979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225989376:12345-0@lo:400:kworker.0 Request processed in 35us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.089984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788592737.090007:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788592737.090015:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475225988992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.090039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475225988992:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.090044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788592737.090055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788592737.090060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475225989504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592737.090106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475225989504:12345-0@lo:400:kworker.0 Request processed in 47us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.090112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788592737.090142:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225989376:0@lo:400:kworker.0 00000100:00080000:3.0:1788592737.090161:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788592737.090329:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b23b80 x1875475225988992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592737.090340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475225988992:0@lo:400:kworker.0 00010000:00080000:2.0:1788592737.090350:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b21c00 x1875475225989504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592737.090357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475225989504:0@lo:400:kworker.0 00010000:00080000:2.0:1788592737.090366:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b21500 x1875475225989120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592737.090373:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225989120:0@lo:400:kworker.0 00010000:00080000:2.0:1788592737.090382:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b20a80 x1875475225989632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592737.090389:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225989632:0@lo:400:kworker.0 00000100:00080000:3.0:1788592737.090441:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592737.090446:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592737.090448:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592737.093421:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225988224 00000100:00100000:1.0:1788592737.093436:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225988224 00000100:00100000:1.0:1788592737.093497:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788592737.093507:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225988224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592737.093607:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225988224:12345-0@lo:400:kworker.0 Request processed in 101us (6886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.093613:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788592737.093676:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225988224:0@lo:400:kworker.0 00010000:00010000:0.0:1788592737.208291:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592737.592763:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225989760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592737.592831:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.594738:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989760 00000100:00100000:2.0:1788592737.594752:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989760 00000100:00100000:2.0:1788592737.594816:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788592737.594826:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225989760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592737.594850:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592737.594918:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225989760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.594935:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788592737.595705:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d2d80 x1875475225989760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592737.595726:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225989760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592738.104343:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592738.104373:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225989888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592738.104448:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592738.104488:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592738.104497:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225990016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592738.104523:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592738.104563:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225989888 00000100:00100000:3.0:1788592738.104571:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225989888 00000100:00100000:3.0:1788592738.104781:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990016 00000100:00100000:3.0:1788592738.104785:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990016 00000100:00100000:3.0:1788592738.104805:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788592738.104813:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225989888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592738.104842:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592738.104948:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225989888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592738.104955:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788592738.104969:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788592738.104975:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225990016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788592738.104999:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592738.105025:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225990016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592738.105031:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788592738.105094:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217438a8380 x1875475225990016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592738.105115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225990016:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788592738.105144:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b4d880 x1875475225989888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592738.105167:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225989888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788592738.232250:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592739.257341:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592739.257386:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592739.257423:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592739.257458:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592739.257489:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592739.257538:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140352 00000100:00100000:2.0:1788592739.257546:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140480 00000100:00100000:2.0:1788592739.257563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140480 00000100:00100000:2.0:1788592739.257638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140736 00000100:00100000:2.0:1788592739.257642:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140736 00000100:00100000:2.0:1788592739.257669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 130 00000100:00100000:2.0:1788592739.257680:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209140480:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592739.257789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209140480:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 109us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.257798:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 130 00000100:00100000:2.0:1788592739.257833:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:2.0:1788592739.257840:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209140736:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592739.257868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209140736:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.257875:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00080000:2.0:1788592739.257985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592739.258007:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140992 00000100:00100000:2.0:1788592739.258012:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140992 00000100:00100000:0.0:1788592739.258019:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140224 00000100:00100000:0.0:1788592739.258030:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140224 00000100:00100000:2.0:1788592739.258116:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:2.0:1788592739.258129:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209140992:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592739.258142:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 301 00000100:00100000:0.0:1788592739.258156:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209140224:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592739.258165:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209140992:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.258176:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00080000:2.0:1788592739.258205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592739.258234:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209140224:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 80us (845us total) trans 0 rc 0/0 00010000:00010000:2.0:1788592739.258240:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592739.258246:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 301 00000100:00100000:3.0:1788592739.259398:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140352 00000100:00100000:3.0:1788592739.259474:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:3.0:1788592739.259485:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209140352:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592739.259539:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592739.259566:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209140352:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 80us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.259576:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:3.0:1788592739.259592:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140608 00000100:00100000:3.0:1788592739.259597:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140608 00000100:00100000:3.0:1788592739.259637:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 133 00000100:00100000:3.0:1788592739.259646:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209140608:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592739.259668:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00080000:1.0:1788592739.260109:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592739.261165:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209140864 00000100:00100000:2.0:1788592739.261180:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209140864 00000100:00100000:2.0:1788592739.261898:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:2.0:1788592739.261915:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209140864:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592739.262023:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209140864:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 113us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.262032:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00080000:1.0:1788592739.262291:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592739.265468:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209140608:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.265490:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 133 00000100:00100000:1.0:1788592740.152493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592740.152578:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592740.152600:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225990272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592740.152670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592740.153700:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990272 00000100:00100000:2.0:1788592740.153709:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990272 00000100:00100000:2.0:1788592740.153765:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788592740.153775:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225990272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592740.153808:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592740.153882:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225990272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592740.153889:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788592740.154054:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225990272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592740.154338:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225990144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592740.154376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592740.154458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990144 00000100:00100000:2.0:1788592740.154463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990144 00000100:00100000:2.0:1788592740.154611:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788592740.154620:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225990144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592740.154641:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788592740.154735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225990144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592740.154743:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788592740.157695:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225990144:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788592740.280548:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788592741.068597:0:12496:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592741.068848:0:12496:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788592741.304236:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592742.200524:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225990528:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.200590:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.200635:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225991040:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.200657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.200678:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225991552:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.200697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.200723:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788592742.200730:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225990656:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.200753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.200772:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225991168:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.200791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.200806:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225991680:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.200824:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.200849:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990528 00000100:00100000:3.0:1788592742.200856:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990528 00000100:00100000:3.0:1788592742.200890:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991040 00000100:00100000:3.0:1788592742.200893:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991040 00000100:00100000:3.0:1788592742.200911:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991552 00000100:00100000:3.0:1788592742.200913:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991552 00000100:00100000:3.0:1788592742.200924:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991168 00000100:00100000:3.0:1788592742.200926:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991168 00000100:00100000:3.0:1788592742.200936:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991680 00000100:00100000:3.0:1788592742.200939:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991680 00000100:00100000:3.0:1788592742.200964:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592742.200973:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225990528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.201024:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475225990528:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592742.201041:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592742.201058:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788592742.201088:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225991040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.201121:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475225991040:12345-0@lo:400:kworker.0 Request processed in 57us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592742.201127:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788592742.201139:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788592742.201144:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225991552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.201336:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225990784:0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.201426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225990400:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.201694:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592742.201721:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225991296:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.201747:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592742.201766:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225991808:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.201785:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592742.201823:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788592742.201832:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225991168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.201860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225991168:12345-0@lo:400:kworker.0 Request processed in 31us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.201866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788592742.201879:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788592742.201885:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225991680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.201913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225991680:12345-0@lo:400:kworker.0 Request processed in 29us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.201919:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788592742.201939:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990656 00000100:00100000:2.0:1788592742.201945:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990656 00000100:00100000:2.0:1788592742.201994:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990784 00000100:00100000:2.0:1788592742.201997:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990784 00000100:00100000:2.0:1788592742.202011:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788592742.202017:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225990656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202052:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225990656:12345-0@lo:400:kworker.0 Request processed in 35us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.202059:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788592742.202092:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788592742.202115:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225990784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202155:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225990784:12345-0@lo:400:kworker.0 Request processed in 42us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.202162:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788592742.202244:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991296 00000100:00100000:2.0:1788592742.202248:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991296 00000100:00100000:2.0:1788592742.202276:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991808 00000100:00100000:2.0:1788592742.202279:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991808 00000100:00100000:2.0:1788592742.202296:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788592742.202302:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225991296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202336:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225991296:12345-0@lo:400:kworker.0 Request processed in 34us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.202342:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788592742.202355:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788592742.202361:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225991808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202389:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225991808:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.202395:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788592742.202421:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592742.202429:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225992064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592742.202454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592742.202551:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225990784:0@lo:400:kworker.0 00010000:00080000:2.0:1788592742.202566:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b23b80 x1875475225991296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592742.202577:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225991296:0@lo:400:kworker.0 00010000:00080000:2.0:1788592742.202587:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743867800 x1875475225991808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592742.202604:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225991808:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202659:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225990656:0@lo:400:kworker.0 00010000:00080000:2.0:1788592742.202671:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b21c00 x1875475225991168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592742.202680:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225991168:0@lo:400:kworker.0 00010000:00080000:2.0:1788592742.202691:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743865880 x1875475225991680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592742.202698:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225991680:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202708:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475225990528:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202717:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475225991040:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202725:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475225991552:0@lo:400:kworker.0 00000100:00100000:2.0:1788592742.202760:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992064 00000100:00100000:2.0:1788592742.202765:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992064 00000100:00100000:2.0:1788592742.202792:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788592742.202798:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225992064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592742.202818:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592742.202852:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475225992064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592742.202858:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788592742.202881:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b4a80 x1875475225992064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592742.202905:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475225992064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592742.203015:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475225991552:12345-0@lo:400:kworker.0 Request processed in 1868us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592742.203022:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788592742.203235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592742.203264:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225990912:0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.203289:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592742.203307:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225991424:0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.203328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592742.203344:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225991936:0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.203362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592742.203392:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990912 00000100:00100000:1.0:1788592742.203396:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990912 00000100:00100000:1.0:1788592742.203419:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788592742.203425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225990912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.203459:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475225990912:12345-0@lo:400:kworker.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592742.203466:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788592742.203488:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592742.203492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592742.203495:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592742.203498:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592742.203506:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991424 00000100:00100000:1.0:1788592742.203510:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991424 00000100:00100000:1.0:1788592742.203536:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225991936 00000100:00100000:1.0:1788592742.203539:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225991936 00000100:00100000:1.0:1788592742.203555:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592742.203561:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225991424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.203604:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225991424:12345-0@lo:400:kworker.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592742.203610:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592742.203622:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592742.203627:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225991936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592742.203649:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225991936:12345-0@lo:400:kworker.0 Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592742.203653:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788592742.203669:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592742.203694:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475225990912:0@lo:400:kworker.0 00010000:00080000:1.0:1788592742.203705:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875b22a00 x1875475225991424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592742.203713:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225991424:0@lo:400:kworker.0 00010000:00080000:1.0:1788592742.203720:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743865f80 x1875475225991936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592742.203728:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225991936:0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.203827:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225990400 00000100:00100000:3.0:1788592742.203833:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225990400 00000100:00100000:3.0:1788592742.203864:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788592742.203871:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225990400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592742.203910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475225990400:12345-0@lo:400:kworker.0 Request processed in 40us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592742.203915:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788592742.203951:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225990400:0@lo:400:kworker.0 00010000:00010000:2.0:1788592742.329397:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592742.712318:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225992192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592742.712389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592742.712487:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992192 00000100:00100000:3.0:1788592742.712495:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992192 00000100:00100000:3.0:1788592742.712654:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788592742.712664:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225992192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592742.712688:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592742.712739:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225992192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592742.712754:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788592742.714320:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743867b80 x1875475225992192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592742.714357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225992192:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1788592742.942159:0:12593:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592742.942550:0:12593:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788592743.225575:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592743.225602:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225992320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592743.225679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592743.226329:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225992448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592743.226366:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592743.226488:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992320 00000100:00100000:1.0:1788592743.226496:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992320 00000100:00100000:2.0:1788592743.226854:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992448 00000100:00100000:2.0:1788592743.226863:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992448 00000100:00100000:2.0:1788592743.226881:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788592743.226890:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225992320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788592743.226917:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592743.226989:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225992320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592743.226995:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788592743.227011:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788592743.227018:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225992448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592743.227027:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592743.227050:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225992448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592743.227056:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788592743.227097:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437bf800 x1875475225992448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592743.227117:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225992448:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788592743.227131:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743867480 x1875475225992320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592743.227160:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225992320:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788592743.352535:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592744.377605:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377646:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377667:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377695:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377713:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377731:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377755:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592744.377781:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141760 00000100:00100000:3.0:1788592744.377790:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141760 00000100:00100000:3.0:1788592744.377851:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141888 00000100:00100000:3.0:1788592744.377854:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141888 00000100:00100000:3.0:1788592744.377876:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:3.0:1788592744.377885:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141760:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592744.377967:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141760:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.377974:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:3.0:1788592744.377991:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:3.0:1788592744.377998:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141888:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592744.378022:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141888:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.378029:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:3.0:1788592744.378046:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141248 00000100:00100000:3.0:1788592744.378049:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141248 00000100:00100000:3.0:1788592744.378092:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141376 00000100:00100000:0.0:1788592744.378092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141504 00000100:00100000:0.0:1788592744.378099:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141504 00000100:00100000:3.0:1788592744.378100:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141376 00000100:00100000:0.0:1788592744.378130:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141632 00000100:00100000:0.0:1788592744.378135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141632 00000100:00100000:3.0:1788592744.378140:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:3.0:1788592744.378151:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209141248:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592744.378161:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 141 00000100:00100000:0.0:1788592744.378171:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141504:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592744.378187:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209141248:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.378195:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:0.0:1788592744.378209:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141504:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.378212:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:3.0:1788592744.378229:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209141376:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592744.378255:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209141376:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 37us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.378261:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:3.0:1788592744.378272:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 143 00000100:00100000:3.0:1788592744.378278:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141632:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592744.378470:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 141 00000100:00100000:0.0:1788592744.378496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209141120 00000100:00100000:0.0:1788592744.378501:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209141120 00000100:00100000:0.0:1788592744.378530:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 303 00000100:00100000:0.0:1788592744.378537:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209141120:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592744.378567:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209141120:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592744.378574:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 303 00000100:00080000:1.0:1788592744.378779:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592744.378784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592744.378786:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592744.378789:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592744.378998:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209141632:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 720us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.379005:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 143 00010000:00010000:0.0:1788592744.380982:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788592744.626599:0:12691:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788592744.626819:0:12691:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788592745.272432:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225992576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592745.272516:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592745.272700:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592745.272711:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225992704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592745.272741:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592745.272829:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992704 00000100:00100000:0.0:1788592745.272829:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992576 00000100:00100000:2.0:1788592745.272838:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992704 00000100:00100000:0.0:1788592745.272845:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992576 00000100:00100000:2.0:1788592745.272890:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788592745.272895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788592745.272899:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225992576:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592745.272900:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225992704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592745.272931:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:0.0:1788592745.272931:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592745.272997:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225992576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592745.272997:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225992704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592745.273004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788592745.273012:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788592745.273117:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225992704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592745.273129:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225992576:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592745.403343:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592746.426875:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788592746.452333:0:12788:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592746.452589:0:12788:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788592747.323718:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225992832:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.323786:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592747.323834:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225993344:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.323859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592747.323888:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225993856:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.323913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592747.323942:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225994368:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.323962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592747.323986:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788592747.323992:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225992960:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592747.324031:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225993472:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324050:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324083:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225993088:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324085:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225993984:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324125:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225993600:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324153:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225994112:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324180:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788592747.324185:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225993216:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592747.324218:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992832 00000100:00100000:1.0:1788592747.324223:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225993728:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324225:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992832 00000100:00100000:1.0:1788592747.324241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324255:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225994240:0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324265:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788592747.324273:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225992832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592747.324298:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993856 00000100:00100000:1.0:1788592747.324308:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993856 00000100:00100000:2.0:1788592747.324318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225992832:12345-0@lo:400:kworker.0 Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324326:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788592747.324339:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994368 00000100:00100000:1.0:1788592747.324342:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994368 00000100:00100000:2.0:1788592747.324353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993344 00000100:00100000:1.0:1788592747.324353:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993728 00000100:00100000:1.0:1788592747.324355:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993728 00000100:00100000:2.0:1788592747.324360:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993344 00000100:00100000:1.0:1788592747.324366:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994240 00000100:00100000:1.0:1788592747.324367:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994240 00000100:00100000:2.0:1788592747.324376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225992960 00000100:00100000:2.0:1788592747.324379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225992960 00000100:00100000:1.0:1788592747.324379:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788592747.324384:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225993856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324388:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993472 00000100:00100000:2.0:1788592747.324390:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993472 00000100:00100000:2.0:1788592747.324400:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993984 00000100:00100000:2.0:1788592747.324402:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993984 00000100:00100000:2.0:1788592747.324412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993600 00000100:00100000:2.0:1788592747.324415:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993600 00000100:00100000:1.0:1788592747.324416:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225993856:12345-0@lo:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592747.324421:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788592747.324424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994112 00000100:00100000:2.0:1788592747.324426:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994112 00000100:00100000:1.0:1788592747.324433:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592747.324437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788592747.324438:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225994368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225993344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324462:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475225994368:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324464:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225993344:12345-0@lo:400:kworker.0 Request processed in 22us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592747.324468:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592747.324469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788592747.324478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788592747.324478:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592747.324484:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225992960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324484:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225993728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475225992960:12345-0@lo:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592747.324509:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225993728:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324512:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788592747.324514:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592747.324523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788592747.324523:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592747.324530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225993472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324530:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225994240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324553:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475225993472:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592747.324553:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225994240:12345-0@lo:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788592747.324559:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592747.324569:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788592747.324574:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225993984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324582:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788592747.324588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225993600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324607:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475225993984:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592747.324611:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225993600:12345-0@lo:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324613:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788592747.324616:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788592747.324624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788592747.324629:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225994112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324638:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993088 00000100:00100000:1.0:1788592747.324641:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993088 00000100:00100000:2.0:1788592747.324652:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225994112:12345-0@lo:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324657:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788592747.324662:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225993216 00000100:00100000:1.0:1788592747.324664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225993216 00000100:00100000:1.0:1788592747.324675:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788592747.324680:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225993088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324701:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475225992960:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324708:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225993088:12345-0@lo:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324711:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475225993472:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788592747.324719:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475225993984:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788592747.324727:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225992832:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324729:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225993216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592747.324735:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225993344:0@lo:400:kworker.0 00010000:00080000:2.0:1788592747.324746:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743992300 x1875475225993856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592747.324752:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225993216:12345-0@lo:400:kworker.0 Request processed in 23us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592747.324757:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225993856:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.324757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1788592747.324767:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743992a00 x1875475225994368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592747.324774:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475225994368:0@lo:400:kworker.0 00000100:00080000:1.0:1788592747.324780:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592747.324783:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592747.324786:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592747.324788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592747.324804:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225993216:0@lo:400:kworker.0 00010000:00080000:1.0:1788592747.324813:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743990380 x1875475225993728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592747.324821:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225993728:0@lo:400:kworker.0 00010000:00080000:1.0:1788592747.324840:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743992680 x1875475225994240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592747.324846:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225994240:0@lo:400:kworker.0 00000100:00100000:1.0:1788592747.325682:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225993088:0@lo:400:kworker.0 00010000:00080000:1.0:1788592747.325701:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743992d80 x1875475225993600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592747.325711:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225993600:0@lo:400:kworker.0 00010000:00080000:1.0:1788592747.325722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991180 x1875475225994112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592747.325730:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225994112:0@lo:400:kworker.0 00000100:00100000:3.0:1788592747.336666:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225994496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592747.336736:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592747.336788:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994496 00000100:00100000:3.0:1788592747.336796:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994496 00000100:00100000:3.0:1788592747.336850:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788592747.336858:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225994496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592747.336886:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592747.336942:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225994496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592747.336950:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788592747.336992:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991880 x1875475225994496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592747.337011:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225994496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788592747.452858:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592747.834910:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225994624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592747.834993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592747.835209:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994624 00000100:00100000:3.0:1788592747.835218:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994624 00000100:00100000:3.0:1788592747.835273:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788592747.835283:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225994624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592747.835306:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592747.835360:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225994624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592747.835366:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788592747.835446:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991880 x1875475225994624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592747.835465:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225994624:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788592747.967969:0:12885:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592747.968381:0:12885:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788592748.344866:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592748.344890:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225994752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592748.344973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592748.345222:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994752 00000100:00100000:2.0:1788592748.345231:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994752 00000100:00100000:2.0:1788592748.345286:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592748.345311:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225994752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592748.345339:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592748.345401:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225994752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592748.345408:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788592748.345472:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743836a00 x1875475225994752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592748.345500:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225994752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592748.345672:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592748.345991:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225994880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592748.346029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592748.346197:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225994880 00000100:00100000:2.0:1788592748.346203:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225994880 00000100:00100000:2.0:1788592748.346268:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592748.346276:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225994880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788592748.346290:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592748.346375:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475225994880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592748.346382:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788592748.346450:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991f80 x1875475225994880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592748.346464:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475225994880:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788592748.476497:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592749.498330:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592749.498406:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592749.498430:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142016 00000100:00100000:3.0:1788592749.498450:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142016 00000100:00100000:2.0:1788592749.498451:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592749.498498:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592749.498534:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592749.498573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 305 00000100:00100000:2.0:1788592749.498582:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592749.498595:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209142016:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592749.498672:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592749.498715:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209142016:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592749.498725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 305 00010000:00010000:0.0:1788592749.498752:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592749.499766:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142656 00000100:00100000:2.0:1788592749.499777:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142656 00000100:00100000:2.0:1788592749.499849:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142784 00000100:00100000:2.0:1788592749.499853:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142784 00000100:00100000:2.0:1788592749.499882:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:2.0:1788592749.499892:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2392:x1875475209142656:12345-192.168.203.47@tcp:9:kworker.0 00000100:00100000:0.0:1788592749.499978:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:0.0:1788592749.499989:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2392:x1875475209142784:12345-192.168.203.47@tcp:9:kworker.0 00000100:00080000:1.0:1788592749.500016:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788592749.500020:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4e18 00000100:00080000:1.0:1788592749.500030:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592749.500030:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9217438b0000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788592749.500059:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788592749.500103:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000020:00000080:2.0:1788592749.500156:0:8590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4e11 00000100:00080000:2.0:1788592749.500163:0:8590:0:(import.c:65:import_set_state_nolock()) ffff9217438b3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788592749.500245:0:8590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788592749.500254:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+2:2392:x1875475209142784:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 266us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592749.500264:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:2.0:1788592749.500337:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+2:2392:x1875475209142656:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 446us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592749.500345:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:2.0:1788592749.500370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142144 00000100:00100000:2.0:1788592749.500374:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142144 00000100:00100000:2.0:1788592749.500398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142400 00000100:00100000:2.0:1788592749.500401:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142400 00000100:00100000:2.0:1788592749.500437:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142272 00000100:00100000:2.0:1788592749.500440:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142272 00000100:00100000:2.0:1788592749.500450:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142528 00000100:00100000:2.0:1788592749.500453:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142528 00000100:00100000:2.0:1788592749.500466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 150 00000100:00100000:2.0:1788592749.500471:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209142144:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592749.500500:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209142144:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592749.500507:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 150 00000100:00100000:2.0:1788592749.500519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 151 00000100:00100000:2.0:1788592749.500525:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209142400:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592749.500549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209142400:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592749.500555:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 151 00000100:00100000:2.0:1788592749.500566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 152 00000100:00100000:2.0:1788592749.500571:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209142272:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592749.500600:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209142272:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592749.500606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 152 00000100:00100000:2.0:1788592749.500616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 153 00000100:00100000:2.0:1788592749.500621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209142528:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592749.500646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209142528:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592749.500651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 153 00000100:00080000:0.0:1788592749.501522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592749.501530:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592749.502384:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592750.393962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225995008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592750.394046:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592750.394147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995008 00000100:00100000:3.0:1788592750.394154:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995008 00000100:00100000:3.0:1788592750.394201:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788592750.394210:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225995008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592750.394231:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225995136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592750.394260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592750.394297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995136 00000100:00100000:0.0:1788592750.394301:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995136 00000100:00100000:0.0:1788592750.394333:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788592750.394338:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225995136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592750.394356:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592750.394401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225995136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592750.394408:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788592750.394450:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225995136:0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592750.395674:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592750.395736:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225995008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1525us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592750.395744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788592750.396022:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225995008:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788592750.520303:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592750.645034:0:13029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788592751.548239:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592752.441229:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592752.441258:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225995264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592752.441359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592752.441441:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995264 00000100:00100000:3.0:1788592752.441451:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995264 00000100:00100000:3.0:1788592752.441535:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788592752.441546:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225995264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592752.441583:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592752.441635:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225995264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592752.441642:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788592752.441902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788592752.441941:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991500 x1875475225995264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592752.441978:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225995264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592752.442758:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225995392:0@lo:400:kworker.0 00000100:00100000:1.0:1788592752.442785:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225995648:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.442847:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592752.442849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592752.442932:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475225995520:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.442942:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225995904:0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.442987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592752.443004:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995392 00000100:00100000:2.0:1788592752.443012:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995392 00000100:00100000:0.0:1788592752.443026:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475225996032:0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.443060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592752.443111:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225996544:0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.443133:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592752.443155:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592752.443161:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788592752.443163:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225996416:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443181:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225995392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.443211:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592752.443242:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225995776:0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.443275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592752.443304:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225996288:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443321:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475225995392:12345-0@lo:400:kworker.0 Request processed in 144us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.443331:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788592752.443339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592752.443366:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225996800:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443381:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995520 00000100:00100000:2.0:1788592752.443388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995520 00000100:00100000:0.0:1788592752.443394:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592752.443435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996032 00000100:00100000:2.0:1788592752.443440:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996032 00000100:00100000:2.0:1788592752.443472:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996544 00000100:00100000:2.0:1788592752.443475:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996544 00000100:00100000:2.0:1788592752.443504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788592752.443510:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475225995520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443555:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475225995520:12345-0@lo:400:kworker.0 Request processed in 45us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.443560:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788592752.443573:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788592752.443578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475225996032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443604:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475225996032:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.443610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788592752.443620:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788592752.443626:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225996544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.443629:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995648 00000100:00100000:0.0:1788592752.443637:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995648 00000100:00100000:2.0:1788592752.443681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475225996544:12345-0@lo:400:kworker.0 Request processed in 53us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.443689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788592752.443696:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995776 00000100:00100000:0.0:1788592752.443701:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995776 00000100:00100000:0.0:1788592752.443726:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788592752.443737:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225995648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443739:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996416 00000100:00100000:2.0:1788592752.443747:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996416 00000100:00100000:2.0:1788592752.443783:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996288 00000100:00100000:2.0:1788592752.443787:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996288 00000100:00100000:0.0:1788592752.443802:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475225995648:12345-0@lo:400:kworker.0 Request processed in 66us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592752.443811:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788592752.443815:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996800 00000100:00100000:2.0:1788592752.443819:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996800 00000100:00100000:0.0:1788592752.443838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788592752.443852:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788592752.443853:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225995776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443868:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225996416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.443913:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225995776:12345-0@lo:400:kworker.0 Request processed in 65us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592752.443923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788592752.443934:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225996416:12345-0@lo:400:kworker.0 Request processed in 69us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.443942:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788592752.443955:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592752.443964:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788592752.443970:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225996288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.443994:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225996800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.444031:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225996288:12345-0@lo:400:kworker.0 Request processed in 66us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592752.444043:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592752.444053:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475225996800:12345-0@lo:400:kworker.0 Request processed in 65us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.444063:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788592752.444126:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225995776:0@lo:400:kworker.0 00000100:00080000:2.0:1788592752.444137:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592752.444145:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592752.444149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788592752.444152:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743836300 x1875475225996288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592752.444168:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225996288:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444175:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788592752.444194:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743836680 x1875475225996800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592752.444243:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475225995392:0@lo:400:kworker.0 00010000:00080000:2.0:1788592752.444282:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743837100 x1875475225996416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592752.444294:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225996416:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475225995520:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444327:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475225996032:0@lo:400:kworker.0 00000100:00100000:1.0:1788592752.444344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475225995648:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444349:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475225996544:0@lo:400:kworker.0 00000100:00100000:1.0:1788592752.444361:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225996160:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444380:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225995904 00000100:00100000:2.0:1788592752.444386:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225995904 00000100:00100000:1.0:1788592752.444403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592752.444441:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225996672:0@lo:400:kworker.0 00000100:00100000:1.0:1788592752.444475:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592752.444520:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996160 00000100:00100000:2.0:1788592752.444534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996160 00000100:00100000:0.0:1788592752.444560:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475225996800:0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788592752.444587:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225995904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.444913:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475225995904:12345-0@lo:400:kworker.0 Request processed in 327us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.444922:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788592752.444953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788592752.444970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225996160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592752.445007:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475225996160:12345-0@lo:400:kworker.0 Request processed in 39us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592752.445014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1788592752.445038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592752.445928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996672 00000100:00100000:3.0:1788592752.445941:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996672 00000100:00100000:3.0:1788592752.446002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788592752.446012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225996672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592752.446587:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475225996672:12345-0@lo:400:kworker.0 Request processed in 575us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592752.446596:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1788592752.446645:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788592752.446767:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743835180 x1875475225996160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592752.446794:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475225996160:0@lo:400:kworker.0 00010000:00080000:1.0:1788592752.446809:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743835c00 x1875475225996672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592752.446819:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475225996672:0@lo:400:kworker.0 00000100:00100000:0.0:1788592752.449369:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475225995904:0@lo:400:kworker.0 00010000:00010000:1.0:1788592752.568245:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592752.953176:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225996928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592752.953246:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592752.954344:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225996928 00000100:00100000:3.0:1788592752.954361:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225996928 00000100:00100000:3.0:1788592752.954441:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788592752.955194:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225996928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592752.955629:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592752.955751:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475225996928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1298us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592752.955762:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788592752.956515:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991500 x1875475225996928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592752.956550:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475225996928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592753.464230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225997056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592753.464306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592753.464900:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225997056 00000100:00100000:3.0:1788592753.464908:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225997056 00000100:00100000:3.0:1788592753.464963:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788592753.464972:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225997056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592753.465010:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592753.466528:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225997184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592753.466597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592753.466647:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225997184 00000100:00100000:1.0:1788592753.466653:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225997184 00000100:00100000:1.0:1788592753.466699:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788592753.466707:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225997184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592753.466726:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592753.466764:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475225997184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592753.466771:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788592753.466826:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743835180 x1875475225997184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592753.466853:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475225997184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592753.469387:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475225997056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4407us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.469403:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788592753.469441:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743835c00 x1875475225997056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592753.469466:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475225997056:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788592753.528253:0:13177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcdf2aef0 20000000:00000080:2.0:1788592753.528271:0:13177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921743a35c00 uarg=0000000000000000 20000000:01000000:2.0:1788592753.528315:0:13177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788592753.528321:0:13177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788592753.528326:0:13177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788592753.529609:0:13178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788592753.529785:0:13177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788592753.537356:0:13177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788592753.537388:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537409:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4daf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537417:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537424:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537643:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537653:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537661:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537669:0:13177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537713:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.537726:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 12 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.537742:0:13177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997312:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592753.539522:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.539539:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 12 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.539553:0:13177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997440:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592753.539591:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.539618:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 23 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.539629:0:13177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997568:0@lo:104: 00000100:00100000:2.0:1788592753.539672:0:13177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592753.539715:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.539726:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 23 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.539737:0:13177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997696:0@lo:104: 00000100:00100000:2.0:1788592753.539768:0:13177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592753.539798:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225997568 00010000:00010000:2.0:1788592753.539804:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.539807:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225997568 00010000:00010000:2.0:1788592753.539817:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 23 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.539828:0:13177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997824:0@lo:104: 00000100:00100000:2.0:1788592753.539858:0:13177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592753.539866:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225997696 00000100:00100000:3.0:1788592753.539871:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225997696 00010000:00010000:2.0:1788592753.539900:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4daf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.539908:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225997824 00010000:00010000:2.0:1788592753.539913:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4daf expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.539914:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225997824 00000100:00100000:2.0:1788592753.539928:0:13177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997952:0@lo:104: 00000100:00100000:3.0:1788592753.539938:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592753.539950:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13177:x1875475225997568:12345-0@lo:104: 00010000:00010000:3.0:1788592753.539963:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.539975:0:13177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592753.539995:0:13177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592753.540046:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225997952 00010000:00010000:3.0:1788592753.540047:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592753.540051:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225997952 00000100:00100000:3.0:1788592753.540057:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13177:x1875475225997568:12345-0@lo:104: Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.540098:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592753.540125:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592753.540134:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13177:x1875475225997696:12345-0@lo:104: 00010000:00010000:3.0:1788592753.540143:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.540166:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788592753.540178:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13177:x1875475225997824:12345-0@lo:104: 00010000:00010000:3.0:1788592753.540189:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788592753.540189:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.540201:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13177:x1875475225997696:12345-0@lo:104: Request processed in 66us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.540210:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592753.540234:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592753.540245:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:13177:x1875475225997952:12345-0@lo:104: 00010000:00010000:2.0:1788592753.540246:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1788592753.540256:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592753.540257:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:13177:x1875475225997824:12345-0@lo:104: Request processed in 82us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592753.540274:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788592753.540326:0:13177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997568:0@lo:104: 00000100:00100000:2.0:1788592753.540703:0:13177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997696:0@lo:104: 00010000:00010000:3.0:1788592753.540705:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788592753.540714:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:13177:x1875475225997952:12345-0@lo:104: Request processed in 471us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592753.540721:0:13177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997824:0@lo:104: 00000100:00100000:3.0:1788592753.540726:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592753.540744:0:13177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997952:0@lo:104: 00010000:00010000:2.0:1788592753.541124:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788592753.541132:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541140:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592753.541144:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541154:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592753.541173:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592753.541180:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592753.541218:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541226:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592753.541259:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541267:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80400/0xbd314a3362db4dd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4de0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541281:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1788592753.541285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225998080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592753.541286:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541299:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592753.541302:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541309:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592753.541316:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592753.541321:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788592753.541334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592753.541344:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541351:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592753.541369:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541375:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4dd2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541386:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592753.541390:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541396:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030c00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592753.541399:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541406:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592753.541412:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592753.541417:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592753.541429:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541435:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592753.541441:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541457:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840030c00/0xbd314a3362db4dbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4dc4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541470:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592753.541473:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541478:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592753.541481:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541488:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592753.541494:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592753.541500:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592753.541512:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541518:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592753.541529:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541535:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840031600/0xbd314a3362db4daf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4db6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.541549:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592753.541644:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592753.541654:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225998464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592753.541678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592753.541708:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592753.541710:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592753.541718:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592753.541727:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225998336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592753.541754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592753.541781:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592753.541787:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225998208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592753.541807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592753.541848:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998080 00000100:00100000:3.0:1788592753.541854:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998080 00010000:00010000:3.0:1788592753.541876:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 24 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.541908:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998464 00000100:00100000:3.0:1788592753.541911:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998464 00010000:00010000:3.0:1788592753.541923:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4daf expref: 25 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.541934:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998336 00000100:00100000:3.0:1788592753.541936:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998336 00010000:00010000:3.0:1788592753.541946:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 26 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.541956:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998208 00000100:00100000:3.0:1788592753.541958:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998208 00010000:00010000:3.0:1788592753.541967:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 27 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592753.542188:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592753.542200:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+27:3642:x1875475225998080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592753.542214:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592753.542220:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 27 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542229:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 27 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542244:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80000/0xbd314a3362db4de0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4dd9 expref: 27 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542258:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592753.542293:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+26:3642:x1875475225998080:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.542301:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592753.542323:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592753.542330:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743990700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+25:3642:x1875475225998464:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592753.542333:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225998080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592753.542340:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592753.542347:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4daf expref: 25 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542356:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4daf expref: 25 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542559:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839400/0xbd314a3362db4db6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4daf expref: 25 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542580:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592753.542615:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743990700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475225998464:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.542621:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592753.542635:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592753.542641:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3640:x1875475225998336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592753.542649:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592753.542653:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 23 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542661:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 23 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542671:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840031400/0xbd314a3362db4dc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4dbd expref: 23 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542680:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592753.542707:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3640:x1875475225998336:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.542712:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592753.542724:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592753.542730:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3640:x1875475225998208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592753.542737:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592753.542742:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 21 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542749:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 21 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542766:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921840030000/0xbd314a3362db4dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4dcb expref: 21 pid: 6507 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592753.542776:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592753.542797:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3640:x1875475225998208:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592753.542803:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592753.542828:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225998208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592753.542836:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475225998336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592753.543544:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475225998464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592753.547363:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592753.547465:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592753.547553:0:13177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997312:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592753.547562:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592753.547573:0:13177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875475225997440:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592753.547612:0:13177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592753.549977:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209142912 00000100:00100000:0.0:1788592753.549990:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209142912 00010000:00010000:0.0:1788592753.550956:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 13 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592753.551005:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143040 00000100:00100000:0.0:1788592753.551010:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143040 00010000:00010000:0.0:1788592753.551038:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 14 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592753.551058:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:0.0:1788592753.551082:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fde4749-eba3-4045-af7c-c124eb85a251+14:2396:x1875475209142912:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592753.551096:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592753.551155:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 14 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592753.551168:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 14 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592753.551184:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80200/0xbd314a3362db4dfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cf6 expref: 14 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592753.551197:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592753.551495:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:2.0:1788592753.551505:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209143040:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592753.551515:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592753.551521:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 13 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551530:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 13 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551541:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f200/0xbd314a3362db4de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb7 expref: 13 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551553:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551576:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551592:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551599:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551605:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551612:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551618:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592753.551622:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551630:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551646:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.551656:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592753.551762:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fde4749-eba3-4045-af7c-c124eb85a251+12:2396:x1875475209142912:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 693us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592753.551777:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:2.0:1788592753.552208:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+11:2396:x1875475209143040:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 703us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592753.552216:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 45 00010000:00010000:1.0:1788592753.555372:0:13177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592753.555391:0:13177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592753.555398:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80600/0xbd314a3362db4e1f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592753.592166:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592754.616196:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592754.618520:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592754.618717:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592754.618749:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592754.618778:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143296 00000100:00100000:3.0:1788592754.618784:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592754.618789:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143296 00000100:00100000:3.0:1788592754.618829:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592754.618854:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143424 00000100:00100000:0.0:1788592754.618858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143424 00000100:00100000:1.0:1788592754.618885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143680 00000100:00100000:0.0:1788592754.618890:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143552 00000100:00100000:1.0:1788592754.618892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143680 00000100:00100000:0.0:1788592754.618904:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143552 00000100:00100000:0.0:1788592754.618928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 160 00000100:00100000:0.0:1788592754.618938:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209143296:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592754.618981:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 161 00000100:00100000:0.0:1788592754.619014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209143296:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.619023:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 160 00000100:00100000:1.0:1788592754.619025:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788592754.619034:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788592754.619046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 162 00000100:00100000:0.0:1788592754.619055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209143552:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592754.619111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209143552:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.619118:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 162 00000100:00100000:0.0:1788592754.619131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 163 00000100:00100000:2.0:1788592754.619179:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143168 00000100:00100000:2.0:1788592754.619184:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143168 00000100:00100000:2.0:1788592754.619213:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 307 00000100:00100000:2.0:1788592754.619221:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:2393:x1875475209143168:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592754.619250:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+11:2393:x1875475209143168:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.619257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 307 00000100:00100000:3.0:1788592754.620086:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209143424:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592754.620130:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209143424:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 1141us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592754.620137:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 161 00000100:00080000:3.0:1788592754.620156:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592754.620161:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592754.620300:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209143680:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592754.620360:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209143680:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 1221us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.620378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 163 10000000:01000000:2.0:1788592754.939865:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592754.939880:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174243f000 from 7 10000000:01000000:2.0:1788592754.939885:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592754.939935:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.939947:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.939958:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592754.939983:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592754.940048:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592754.940654:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217427196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592754.941896:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998592 00000100:00100000:0.0:1788592754.941909:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998592 00000100:00100000:0.0:1788592754.942050:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788592754.942083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475225998592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592754.942101:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592754.942118:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4e26 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.942146:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.942157:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.942167:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0a00, rc 0) 00000100:00100000:0.0:1788592754.942242:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225998592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.942250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788592754.942596:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592754.942621:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592754.942650:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592754.942742:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.942786:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.942829:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.942945:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998720 00000100:00100000:2.0:1788592754.942951:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998720 00000100:00100000:2.0:1788592754.942988:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788592754.942996:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225998720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592754.943127:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225998720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.943144:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788592754.943282:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.943318:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.943364:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.943425:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.945626:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998848 00000100:00100000:2.0:1788592754.945639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998848 00000100:00100000:2.0:1788592754.945928:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788592754.945941:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225998848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592754.946108:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225998848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.946116:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788592754.947092:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788592754.948309:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788592754.948699:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788592754.948723:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592754.948734:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.948843:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592754.948855:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592754.948857:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218764b9000 from 7 10000000:01000000:0.0:1788592754.948860:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592754.948907:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.948926:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.948937:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592754.948961:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.949021:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592754.949167:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225998976 00000100:00100000:2.0:1788592754.949174:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225998976 00000100:00100000:0.0:1788592754.949262:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.949315:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788592754.949325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475225998976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592754.949337:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592754.949357:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4e34 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.949381:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.949392:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.949400:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80400, rc 0) 00000100:00100000:2.0:1788592754.949448:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225998976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.949455:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788592754.949523:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225998976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592754.949550:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.949559:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592754.949610:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.949635:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592754.949900:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592754.949928:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999104 00000100:00100000:3.0:1788592754.949933:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999104 00000100:00100000:3.0:1788592754.949955:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788592754.949962:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225999104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.950104:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225999104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592754.950112:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788592754.950255:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.950283:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.950323:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592754.950427:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592754.950469:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999232 00000100:00100000:3.0:1788592754.950473:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999232 00000100:00100000:3.0:1788592754.950502:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788592754.950509:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225999232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.950751:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225999232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592754.950768:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788592754.950922:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788592754.951994:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788592754.952096:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788592754.952126:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592754.952135:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.952144:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592754.952154:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592754.952156:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921875948800 from 7 10000000:01000000:0.0:1788592754.952159:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592754.952184:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.952192:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.952201:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592754.952224:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.952271:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592754.952353:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.953628:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999360 00000100:00100000:2.0:1788592754.953646:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999360 00000100:00100000:2.0:1788592754.953693:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788592754.953702:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475225999360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592754.953714:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592754.953726:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4e42 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.953893:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.953905:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592754.953968:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80600, rc 0) 00000100:00100000:2.0:1788592754.954030:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225999360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 329us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.954036:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788592754.954925:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592754.954946:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592754.954956:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592754.955026:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743990700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.955078:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.955114:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.955742:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999488 00000100:00100000:2.0:1788592754.955758:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999488 00000100:00100000:2.0:1788592754.955805:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788592754.955813:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225999488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592754.956027:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225999488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.956034:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788592754.957295:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743990700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.957350:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743990700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.957400:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.957437:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.957529:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999616 00000100:00100000:2.0:1788592754.957536:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999616 00000100:00100000:2.0:1788592754.957581:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788592754.957590:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225999616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592754.957700:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225999616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.957707:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788592754.957727:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743990700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788592754.962432:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788592754.962639:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788592754.962669:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592754.962680:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.962691:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592754.962718:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592754.962720:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921846c66000 from 7 10000000:01000000:0.0:1788592754.962723:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592754.962758:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.962766:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.962775:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592754.962799:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.962896:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592754.962933:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592754.962954:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999744 00000100:00100000:0.0:1788592754.962961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999744 00000100:00100000:0.0:1788592754.963001:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788592754.963009:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475225999744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592754.963021:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592754.963033:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4e50 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.963056:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.963090:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.963110:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1400, rc 0) 00000100:00100000:0.0:1788592754.963149:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225999744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.963156:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788592754.963210:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592754.963223:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.963231:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592754.963281:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.963305:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592754.963315:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592754.964114:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475225999872 00000100:00100000:2.0:1788592754.964122:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475225999872 00000100:00100000:2.0:1788592754.965000:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788592754.965015:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225999872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592754.965185:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475225999872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.965194:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788592754.965297:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475225999872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.965343:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226000000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592754.965385:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592754.967974:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000000 00000100:00100000:0.0:1788592754.967987:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000000 00000100:00100000:3.0:1788592754.967990:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592754.968031:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788592754.968039:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226000000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592754.968189:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226000000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.968197:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788592754.968398:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226000000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788592754.971211:0:13237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788592754.972900:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788592754.972933:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592754.972946:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592754.972972:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592755.446752:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592755.446789:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143808 00000100:00100000:0.0:1788592755.446797:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143808 00000100:00100000:0.0:1788592755.446840:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 320 00000100:00100000:0.0:1788592755.446847:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+11:6162:x1875475209143808:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592755.446860:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592755.446889:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d27 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592755.447216:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592755.447231:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592755.447240:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1c00, rc 0) 00000100:00100000:0.0:1788592755.447297:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209143808:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 450us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.447305:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 320 00000100:00100000:1.0:1788592755.449855:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592755.449958:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209143936 00000100:00100000:2.0:1788592755.449968:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209143936 00000100:00100000:2.0:1788592755.450024:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 321 00000100:00100000:2.0:1788592755.450035:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209143936:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592755.450220:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209143936:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 186us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592755.450228:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 321 00000100:00100000:3.0:1788592755.452708:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592755.452815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144064 00000100:00100000:0.0:1788592755.452826:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144064 00000100:00100000:0.0:1788592755.452889:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 322 00000100:00100000:0.0:1788592755.452901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209144064:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592755.453049:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209144064:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 149us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.453060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 322 00000100:00100000:1.0:1788592755.458152:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592755.458259:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144192 00000100:00100000:0.0:1788592755.458270:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144192 00000100:00100000:0.0:1788592755.458339:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 323 00000100:00100000:0.0:1788592755.458350:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209144192:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592755.458371:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592755.458390:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d2e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592755.458417:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592755.458429:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592755.458438:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0c00, rc 0) 00000100:00100000:0.0:1788592755.458496:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209144192:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 148us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.458503:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 323 00000100:00100000:3.0:1788592755.461381:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592755.462152:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144320 00000100:00100000:0.0:1788592755.462163:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144320 00000100:00100000:0.0:1788592755.462221:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 324 00000100:00100000:0.0:1788592755.462233:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209144320:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592755.462394:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209144320:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 163us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.462409:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 324 00000100:00100000:3.0:1788592755.463986:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592755.464764:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144448 00000100:00100000:0.0:1788592755.464775:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144448 00000100:00100000:0.0:1788592755.464827:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 325 00000100:00100000:0.0:1788592755.464838:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209144448:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592755.465031:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209144448:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 193us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.465040:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 325 00000100:00100000:2.0:1788592755.512658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226000128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592755.512731:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592755.513197:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000128 00000100:00100000:2.0:1788592755.513206:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000128 00000100:00100000:2.0:1788592755.513253:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592755.513260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226000128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592755.513294:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592755.513355:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226000128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592755.513362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592755.513503:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226000128:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788592755.514321:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000020:00000080:3.0:1788592755.514326:0:9505:0:(genops.c:885:class_export_put()) final put ffff9217438b7800/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000020:00000080:2.0:1788592755.514390:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9217438b7800/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 for lustre-OST0001 00000020:00000080:2.0:1788592755.514535:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217438b0000 for lustre-OST0001 00000100:00100000:1.0:1788592755.514981:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592755.514996:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226000256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592755.515047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592755.515100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000256 00000100:00100000:1.0:1788592755.515106:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000256 00000100:00100000:1.0:1788592755.515159:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788592755.515167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226000256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592755.515215:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592755.515265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226000256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592755.515271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788592755.515469:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226000256:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788592755.518398:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000020:00000080:1.0:1788592755.518408:0:8422:0:(genops.c:885:class_export_put()) final put ffff9217438b2800/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000020:00000080:2.0:1788592755.518480:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9217438b2800/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 for lustre-OST0000 00000020:00000080:2.0:1788592755.518539:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217438b3000 for lustre-OST0000 00010000:00010000:2.0:1788592755.640238:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788592756.383813:0:13376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788592756.664200:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592757.560318:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226000384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592757.560411:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.560509:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000384 00000100:00100000:1.0:1788592757.560518:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000384 00000100:00100000:1.0:1788592757.560581:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788592757.560594:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226000384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592757.560631:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592757.560683:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226000384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.560690:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788592757.560713:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788592757.560770:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991f80 x1875475226000384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592757.560791:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226000384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592757.561040:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226000512:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561100:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561173:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226001024:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561221:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226001536:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561269:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788592757.561275:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226000640:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561314:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226001152:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226001664:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001024 00000100:00100000:1.0:1788592757.561399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001024 00000100:00100000:1.0:1788592757.561435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000640 00000100:00100000:1.0:1788592757.561438:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000640 00000100:00100000:1.0:1788592757.561452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001152 00000100:00100000:1.0:1788592757.561454:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001152 00000100:00100000:1.0:1788592757.561472:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001664 00000100:00100000:1.0:1788592757.561475:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001664 00000100:00100000:1.0:1788592757.561489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788592757.561496:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226001024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561546:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226001024:12345-0@lo:400:kworker.0 Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.561553:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788592757.561566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788592757.561572:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226000640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226000640:12345-0@lo:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.561607:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788592757.561620:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788592757.561626:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226001152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226001152:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.561657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788592757.561668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788592757.561674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475226001664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475226001664:12345-0@lo:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.561705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788592757.561724:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001536 00000100:00100000:1.0:1788592757.561728:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001536 00000100:00100000:1.0:1788592757.561754:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788592757.561761:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226001536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561790:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226001536:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.561796:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788592757.561826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592757.561831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592757.561842:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226000896:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561905:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226001408:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561943:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226001920:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.561963:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.561979:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788592757.561985:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226000768:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.562021:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226001280:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.562057:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226001792:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562101:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592757.562126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000896 00000100:00100000:1.0:1788592757.562130:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000896 00000100:00100000:1.0:1788592757.562152:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000768 00000100:00100000:1.0:1788592757.562155:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000768 00000100:00100000:1.0:1788592757.562167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788592757.562173:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226000896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226000896:12345-0@lo:400:kworker.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.562215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788592757.562226:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788592757.562231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226000768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562264:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226000768:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.562270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788592757.562286:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001280 00000100:00100000:1.0:1788592757.562289:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001280 00000100:00100000:1.0:1788592757.562315:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001792 00000100:00100000:1.0:1788592757.562317:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001792 00000100:00100000:2.0:1788592757.562330:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001408 00000100:00100000:1.0:1788592757.562335:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788592757.562337:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001408 00000100:00100000:1.0:1788592757.562343:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226001280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562375:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226001280:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.562380:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788592757.562391:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226001920 00000100:00100000:1.0:1788592757.562396:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788592757.562397:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226001920 00000100:00100000:1.0:1788592757.562404:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226001792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562435:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226001792:12345-0@lo:400:kworker.0 Request processed in 32us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.562442:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788592757.562447:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788592757.562456:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226001408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788592757.562463:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592757.562467:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592757.562469:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592757.562500:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226000640:0@lo:400:kworker.0 00000100:00100000:2.0:1788592757.562502:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226001408:12345-0@lo:400:kworker.0 Request processed in 47us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592757.562512:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788592757.562518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226001152:0@lo:400:kworker.0 00000100:00100000:2.0:1788592757.562530:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592757.562532:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226001664:0@lo:400:kworker.0 00000100:00100000:2.0:1788592757.562542:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226001920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226001024:0@lo:400:kworker.0 00010000:00080000:1.0:1788592757.562562:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743993480 x1875475226001536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592757.562578:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226001920:12345-0@lo:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592757.562579:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226001536:0@lo:400:kworker.0 00000100:00100000:2.0:1788592757.562591:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592757.562634:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226000768:0@lo:400:kworker.0 00010000:00080000:1.0:1788592757.562647:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743992300 x1875475226001280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592757.562656:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226001280:0@lo:400:kworker.0 00010000:00080000:1.0:1788592757.562665:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991500 x1875475226001792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592757.562673:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226001792:0@lo:400:kworker.0 00000100:00100000:1.0:1788592757.562680:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226000896:0@lo:400:kworker.0 00010000:00080000:1.0:1788592757.562687:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743993100 x1875475226001408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592757.562694:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226001408:0@lo:400:kworker.0 00010000:00080000:1.0:1788592757.562701:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743990700 x1875475226001920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592757.562708:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226001920:0@lo:400:kworker.0 00000100:00100000:3.0:1788592757.563931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226000512 00000100:00100000:3.0:1788592757.563944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226000512 00000100:00100000:3.0:1788592757.564026:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788592757.564036:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592757.564130:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226000512:12345-0@lo:400:kworker.0 Request processed in 96us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592757.564137:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788592757.564221:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226000512:0@lo:400:kworker.0 00010000:00010000:0.0:1788592757.688404:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592758.072368:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226002048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592758.072438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592758.076140:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002048 00000100:00100000:3.0:1788592758.076156:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002048 00000100:00100000:3.0:1788592758.076233:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788592758.076245:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226002048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592758.076274:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592758.076350:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226002048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592758.076357:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788592758.076752:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743993800 x1875475226002048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592758.076773:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226002048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592758.586200:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226002176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592758.586270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592758.586319:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226002304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592758.586343:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002176 00000100:00100000:1.0:1788592758.586351:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002176 00000100:00100000:1.0:1788592758.586402:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592758.586421:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226002176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592758.586450:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592758.586476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592758.586505:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226002176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592758.586518:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002304 00000100:00100000:0.0:1788592758.586523:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002304 00000100:00100000:1.0:1788592758.586524:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592758.586549:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592758.586557:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226002304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592758.586567:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592758.586610:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226002304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (134us total) trans 0 rc 0/0 00010000:00080000:2.0:1788592758.586672:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b53b80 x1875475226002304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592758.586692:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226002304:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788592758.586718:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d9880 x1875475226002176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592758.586734:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788592758.586736:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226002176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788592758.712182:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592759.736541:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592759.739554:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592759.739613:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592759.739649:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592759.739679:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592759.739710:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592759.739750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144832 00000100:00100000:1.0:1788592759.739762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144832 00000100:00100000:1.0:1788592759.739868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209145088 00000100:00100000:1.0:1788592759.739872:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209145088 00000100:00100000:1.0:1788592759.739892:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144704 00000100:00100000:1.0:1788592759.739894:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144704 00000100:00100000:1.0:1788592759.739909:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144960 00000100:00100000:1.0:1788592759.739923:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144960 00000100:00100000:1.0:1788592759.739945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 170 00000100:00100000:1.0:1788592759.739956:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209144832:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592759.740130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209144832:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 175us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.740138:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 170 00000100:00100000:1.0:1788592759.740158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 171 00000100:00100000:1.0:1788592759.740166:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209145088:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592759.740194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209145088:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.740200:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 171 00000100:00100000:1.0:1788592759.740212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 172 00000100:00100000:1.0:1788592759.740217:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209144704:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592759.740244:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209144704:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.740249:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 172 00000100:00100000:1.0:1788592759.740261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 173 00000100:00100000:1.0:1788592759.740267:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209144960:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592759.740290:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209144960:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00080000:2.0:1788592759.740403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592759.740414:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592759.743847:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209144576 00000100:00100000:0.0:1788592759.743870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209144576 00000100:00100000:1.0:1788592759.744018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 173 00000100:00100000:0.0:1788592759.748675:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 327 00000100:00100000:0.0:1788592759.748720:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209144576:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592759.748874:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209144576:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 176us (9333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592759.756256:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 327 00000001:02000400:2.0:1788592760.604500:0:13525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:19:19 (1788592759) === 00000100:00100000:3.0:1788592760.634553:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592760.634574:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226002432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592760.634641:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592760.634701:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002432 00000100:00100000:3.0:1788592760.634708:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002432 00000100:00100000:3.0:1788592760.634753:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788592760.634761:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226002432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788592760.634791:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592760.634852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226002432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.634870:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788592760.634919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226002432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592760.637584:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226002560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592760.637650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592760.638569:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002560 00000100:00100000:1.0:1788592760.638579:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002560 00000100:00100000:1.0:1788592760.638633:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788592760.638641:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226002560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592760.638678:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788592760.638747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226002560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592760.638754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788592760.644923:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226002560:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788592760.760454:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592760.850771:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.850855:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209145216 00000100:00100000:2.0:1788592760.850864:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209145216 00000100:00100000:0.0:1788592760.850875:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.850918:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:3.0:1788592760.850956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209145344 00000100:00100000:3.0:1788592760.850960:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209145344 00000100:00100000:3.0:1788592760.850995:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:3.0:1788592760.851004:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10487:x1875475209145344:12345-192.168.203.47@tcp:700:mkdir.0 00000100:00100000:3.0:1788592760.851098:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10487:x1875475209145344:12345-192.168.203.47@tcp:700:mkdir.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.851106:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:2.0:1788592760.851225:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209145216:12345-192.168.203.47@tcp:41:mkdir.0 00000004:00000024:2.0:1788592760.851250:0:13208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788592760.852106:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209145216:12345-192.168.203.47@tcp:41:mkdir.0 Request processed in 1176us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592760.853950:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:0.0:1788592760.854054:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592760.854147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209145600 00000100:00100000:3.0:1788592760.854156:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209145600 00000100:00100000:3.0:1788592760.854194:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:3.0:1788592760.854203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:10487:x1875475209145600:12345-192.168.203.47@tcp:36:mkdir.0 00010000:00010000:3.0:1788592760.854257:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592760.854328:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db4d0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ca2 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.854353:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:3.0:1788592760.854365:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592760.854610:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.854626:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.854636:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.854681:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.854690:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.854697:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855242:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855253:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855260:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592760.855274:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a505a85 reply state 00000000658dc0e1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855284:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855290:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff92184525bc00) 00010000:00010000:3.0:1788592760.855293:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592760.855296:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788592760.855300:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788592760.855306:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855313:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855326:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855332:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592760.855336:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855344:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855353:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184525b000) 00010000:00010000:3.0:1788592760.855356:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592760.855360:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855366:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592760.855381:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a505a85 reply state 00000000658dc0e1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855389:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.855395:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92184525b700) 00010000:00010000:3.0:1788592760.855397:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592760.855399:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788592760.855484:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10487:x1875475209145600:12345-192.168.203.47@tcp:36:mkdir.0 Request processed in 1279us (1428us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788592760.855491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:3.0:1788592760.887213:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592760.887722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209145728 00000100:00100000:1.0:1788592760.887739:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209145728 00000100:00100000:1.0:1788592760.887815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:1.0:1788592760.887839:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10488:x1875475209145728:12345-192.168.203.47@tcp:101:chmod.0 00010000:00010000:1.0:1788592760.887866:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592760.887898:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db4e81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d35 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.887969:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4e88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.887985:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4e88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.887999:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4e88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592760.888045:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788592760.888049:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592760.888124:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4e88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.888151:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db4e81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d35 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.888167:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4e88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d35 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.888195:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765dfe00) 00010000:00010000:1.0:1788592760.888198:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592760.888202:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838800, rc 0) 00000100:00100000:1.0:1788592760.888269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:10488:x1875475209145728:12345-192.168.203.47@tcp:101:chmod.0 Request processed in 444us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592760.888276:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:0.0:1788592760.892215:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.892298:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209145984 00000100:00100000:2.0:1788592760.892314:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209145984 00000100:00100000:2.0:1788592760.892393:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1788592760.892405:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:10488:x1875475209145984:12345-192.168.203.47@tcp:36:chmod.0 00010000:00010000:2.0:1788592760.892461:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592760.892492:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4e88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d35 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.892518:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765dfe00) 00010000:00010000:2.0:1788592760.892530:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592760.892759:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.892774:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.892800:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592760.893001:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a628b81d reply state 00000000da7de1a4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.893013:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.893020:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:2.0:1788592760.893023:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788592760.893026:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788592760.893034:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788592760.893166:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:10488:x1875475209145984:12345-192.168.203.47@tcp:36:chmod.0 Request processed in 763us (968us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788592760.893173:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:0.0:1788592760.917587:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592760.917707:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209146112 00000100:00100000:3.0:1788592760.917721:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209146112 00000100:00100000:3.0:1788592760.917799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:3.0:1788592760.917813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:10489:x1875475209146112:12345-192.168.203.47@tcp:101:chown.0 00010000:00010000:3.0:1788592760.917856:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592760.917884:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d3c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.917975:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db4e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.917993:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db4e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.918008:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db4e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592760.918608:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788592760.918615:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592760.918815:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db4e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.918869:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db4e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d3c expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.918894:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db4e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d3c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.918905:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:3.0:1788592760.918915:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592760.918921:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ee00, rc 0) 00000100:00100000:2.0:1788592760.920001:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:10489:x1875475209146112:12345-192.168.203.47@tcp:101:chown.0 Request processed in 2179us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592760.920014:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:3.0:1788592760.923734:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592760.924225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209146240 00000100:00100000:1.0:1788592760.924236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209146240 00000100:00100000:1.0:1788592760.924305:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:1.0:1788592760.924316:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:10489:x1875475209146240:12345-192.168.203.47@tcp:101:chown.0 00010000:00010000:1.0:1788592760.924337:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592760.924360:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db4ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d43 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924426:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924440:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924452:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924464:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924471:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924496:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924582:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db4eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924592:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db4eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924599:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db4eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592760.924639:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788592760.924644:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592760.924666:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db4eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924678:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924685:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924691:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924697:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592760.924702:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924709:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924728:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:1.0:1788592760.924735:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592760.924740:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924916:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924931:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924937:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924942:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924946:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592760.924949:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924955:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924963:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92184525b700) 00010000:00010000:1.0:1788592760.924965:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592760.924968:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.924973:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.925009:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db4ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d43 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.925021:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db4eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d43 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.925027:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff92184525bc00) 00010000:00010000:1.0:1788592760.925029:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592760.925032:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839400, rc 0) 00000100:00100000:1.0:1788592760.925123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:10489:x1875475209146240:12345-192.168.203.47@tcp:101:chown.0 Request processed in 808us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592760.925130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:0.0:1788592760.929261:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592760.929355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209146368 00000100:00100000:1.0:1788592760.929364:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209146368 00000100:00100000:1.0:1788592760.929442:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:1.0:1788592760.929451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:10489:x1875475209146368:12345-192.168.203.47@tcp:900:chown.0 00000100:00100000:1.0:1788592760.929527:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:10489:x1875475209146368:12345-192.168.203.47@tcp:900:chown.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592760.929535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:0.0:1788592760.933731:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.933886:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209146624 00000100:00100000:2.0:1788592760.933896:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209146624 00000100:00100000:2.0:1788592760.933956:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:2.0:1788592760.933967:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:10489:x1875475209146624:12345-192.168.203.47@tcp:36:chown.0 00010000:00010000:2.0:1788592760.934023:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592760.934050:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db4eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d43 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.934097:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff92184525bc00) 00010000:00010000:2.0:1788592760.934117:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592760.934143:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.934157:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.934167:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788592760.939793:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1788592760.939939:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000093cbfd3 reply state 00000000a52c4c5d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.939962:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.939972:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff92184525bc00) 00010000:00010000:2.0:1788592760.939975:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788592760.939979:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788592760.939991:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788592760.940134:0:13208:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788592760.940160:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:10489:x1875475209146624:12345-192.168.203.47@tcp:36:chown.0 Request processed in 6192us (6433us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788592760.940168:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00010000:00010000:1.0:1788592760.940657:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.940668:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.940675:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.940695:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592760.940699:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.940707:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.940720:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff92184525bc00) 00010000:00010000:1.0:1788592760.940722:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788592760.940726:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.940732:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80e00/0xbd314a3362db4ec0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941449:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941460:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941466:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941472:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592760.941476:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941482:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941494:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92184525b700) 00010000:00010000:3.0:1788592760.941497:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592760.941500:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941507:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4e73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941524:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941530:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941548:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941553:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ec00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592760.941556:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941563:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941571:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff92184525bc00) 00010000:00010000:3.0:1788592760.941574:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592760.941577:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941583:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4e7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941599:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941605:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941696:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941701:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592760.941705:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941722:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941731:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:3.0:1788592760.941733:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592760.941736:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.941742:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81a00/0xbd314a3362db4e8f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592760.962455:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.962644:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209146752 00000100:00100000:2.0:1788592760.962655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209146752 00000100:00100000:2.0:1788592760.962717:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:2.0:1788592760.962728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:10490:x1875475209146752:12345-192.168.203.47@tcp:101:touch.500 00010000:00010000:2.0:1788592760.962750:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592760.962771:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d4a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592760.967152:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4298us 00010000:00010000:2.0:1788592760.982530:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982554:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982567:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982581:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982588:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982595:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982721:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db4edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982729:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db4edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982736:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db4edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592760.982763:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788592760.982766:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592760.982816:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db4edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982840:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982846:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982853:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982858:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592760.982863:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982880:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982893:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:2.0:1788592760.982896:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592760.982900:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982906:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4ece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982917:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982923:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982929:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982939:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592760.982943:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982949:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982957:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921743723400) 00010000:00010000:2.0:1788592760.982960:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592760.982963:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.982969:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4ed5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.983006:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d4a expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.983022:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db4edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d4a expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.983028:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:2.0:1788592760.983031:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788592760.983033:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81800, rc 0) 00000100:00100000:2.0:1788592760.983309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10490:x1875475209146752:12345-192.168.203.47@tcp:101:touch.500 Request processed in 20581us (20864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592760.983318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1788592760.987386:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592760.987536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209147008 00000100:00100000:1.0:1788592760.987545:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209147008 00000100:00100000:1.0:1788592760.987625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:1.0:1788592760.987635:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10490:x1875475209147008:12345-192.168.203.47@tcp:101:touch.500 00010000:00010000:1.0:1788592760.987663:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592760.987683:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db4ee3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.987782:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.987796:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.987808:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.987848:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.987856:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.987863:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592760.988252:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788592760.988377:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db4ef8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988387:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db4ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988407:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db4ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988440:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988446:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988452:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988459:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592760.988463:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988482:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988493:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:1.0:1788592760.988496:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592760.988500:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988507:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db4eea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592760.988518:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7a20dde reply state 00000000f95ff58c transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988530:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988536:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9218765e0a00) 00010000:00010000:1.0:1788592760.988538:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788592760.988541:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788592760.988568:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db4ee3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d51 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988582:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db4ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d51 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.988589:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9218765e0d00) 00010000:00010000:1.0:1788592760.988591:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592760.988593:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838400, rc 0) 00000100:00100000:1.0:1788592760.988798:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:10490:x1875475209147008:12345-192.168.203.47@tcp:101:touch.500 Request processed in 1164us (1420us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788592760.988812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:3.0:1788592760.993417:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.993512:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209147264 00000100:00100000:2.0:1788592760.993535:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209147264 00000100:00100000:2.0:1788592760.993589:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:2.0:1788592760.993599:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:10490:x1875475209147264:12345-192.168.203.47@tcp:36:touch.500 00010000:00010000:2.0:1788592760.993658:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592760.993685:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db4ef8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d51 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.993704:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9218765e0d00) 00010000:00010000:2.0:1788592760.993715:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592760.993768:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.993780:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.993790:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592760.993902:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fd14f4f reply state 0000000071a8423c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.993925:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.993932:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:2.0:1788592760.993934:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592760.993936:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592760.994021:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:10490:x1875475209147264:12345-192.168.203.47@tcp:36:touch.500 Request processed in 423us (612us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788592760.994028:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:3.0:1788592760.996259:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592760.996359:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209147392 00000100:00100000:2.0:1788592760.996368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209147392 00000100:00100000:2.0:1788592760.996419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:2.0:1788592760.996428:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:10490:x1875475209147392:12345-192.168.203.47@tcp:101:touch.500 00010000:00010000:2.0:1788592760.996448:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592760.996467:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4f0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d58 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.996520:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d58 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.996534:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d58 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.996552:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:2.0:1788592760.996555:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592760.996558:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81600, rc 0) 00000100:00100000:2.0:1788592760.996600:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:10490:x1875475209147392:12345-192.168.203.47@tcp:101:touch.500 Request processed in 173us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592760.996607:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:0.0:1788592761.001822:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592761.001939:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209147520 00000100:00100000:2.0:1788592761.001950:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209147520 00000100:00100000:2.0:1788592761.002008:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:2.0:1788592761.002017:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875475209147520:12345-192.168.203.47@tcp:8:touch.500 00010000:00080000:2.0:1788592761.002063:0:8590:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:2.0:1788592761.002147:0:8590:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db4f14 00002000:00100000:2.0:1788592761.002160:0:8590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7fa053f8-dea8-45a9-81cb-9946b4fa9e00/ffff9218767b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788592761.002194:0:8590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788592761.002311:0:8590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788592761.002355:0:8590:0:(import.c:65:import_set_state_nolock()) ffff9217439bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592761.002428:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209147520:12345-192.168.203.47@tcp:8:touch.500 Request processed in 410us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592761.002437:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:3.0:1788592761.005884:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592761.006028:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209147648 00000100:00100000:2.0:1788592761.006037:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209147648 00000100:00080000:1.0:1788592761.006236:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592761.006673:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1788592761.006683:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:0:x1875475209147648:12345-192.168.203.47@tcp:2:touch.500 00000001:00080000:2.0:1788592761.014873:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788592761.014943:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000100:00100000:0.0:1788592761.015329:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:0:x1875475209147648:12345-192.168.203.47@tcp:2:touch.500 Request processed in 8641us (9448us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788592761.015341:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:3.0:1788592761.021773:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592761.021897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209147904 00000100:00100000:1.0:1788592761.021906:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209147904 00000100:00100000:1.0:1788592761.021983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:1.0:1788592761.021992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:10490:x1875475209147904:12345-192.168.203.47@tcp:35:touch.500 00000100:00100000:1.0:1788592761.022281:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:10490:x1875475209147904:12345-192.168.203.47@tcp:35:touch.500 Request processed in 289us (515us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788592761.022289:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00080000:2.0:1788592761.022849:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592761.047261:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592761.047421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209148032 00000100:00100000:3.0:1788592761.047432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209148032 00000100:00100000:3.0:1788592761.047490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:3.0:1788592761.047500:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:10491:x1875475209148032:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:3.0:1788592761.047524:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592761.047545:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.047609:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4f22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.047623:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4f22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.047648:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4f22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592761.047692:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788592761.047696:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592761.047737:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4f22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.047767:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ec00/0xbd314a3362db4f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d5f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.047785:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4f22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d5f expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.047793:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:3.0:1788592761.047796:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592761.047799:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f800, rc 0) 00000100:00100000:3.0:1788592761.047870:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:10491:x1875475209148032:12345-192.168.203.47@tcp:101:rm.0 Request processed in 371us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592761.047877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:3.0:1788592761.054257:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592761.054355:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209148288 00000100:00100000:2.0:1788592761.054366:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209148288 00000100:00100000:2.0:1788592761.054436:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:2.0:1788592761.054446:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:10491:x1875475209148288:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:2.0:1788592761.054465:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592761.054486:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d66 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592761.054608:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788592761.054706:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4f29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d66 expref: 16 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.054721:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:2.0:1788592761.054730:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592761.054738:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80000/0xbd314a3362db4f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d66 expref: 16 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.054752:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80000, rc 0) 00000100:00100000:2.0:1788592761.054962:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:10491:x1875475209148288:12345-192.168.203.47@tcp:101:rm.0 Request processed in 516us (713us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788592761.054969:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:1.0:1788592761.065566:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592761.065667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209148416 00000100:00100000:2.0:1788592761.065677:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209148416 00000100:00100000:2.0:1788592761.065732:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:2.0:1788592761.065743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:10491:x1875475209148416:12345-192.168.203.47@tcp:37:rm.0 00000100:00100000:2.0:1788592761.070931:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:10491:x1875475209148416:12345-192.168.203.47@tcp:37:rm.0 Request processed in 5178us (5363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592761.070944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:3.0:1788592761.083012:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592761.083125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209148672 00000100:00100000:0.0:1788592761.083135:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209148672 00000100:00100000:0.0:1788592761.083183:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:0.0:1788592761.083194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186969e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:10491:x1875475209148672:12345-192.168.203.47@tcp:35:rm.0 00000100:00100000:0.0:1788592761.083429:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186969e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:10491:x1875475209148672:12345-192.168.203.47@tcp:35:rm.0 Request processed in 237us (425us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788592761.083452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:1.0:1788592761.092601:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592761.093543:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209148928 00000100:00100000:0.0:1788592761.093555:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209148928 00000100:00100000:0.0:1788592761.093621:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:0.0:1788592761.093631:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:10491:x1875475209148928:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1788592761.093774:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592761.093858:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d6d expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.093963:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db4f3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.093978:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db4f3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.093990:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db4f3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592761.094001:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788592761.094162:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d6d expref: 19 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.094181:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db4f3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d6d expref: 18 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.094190:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:0.0:1788592761.094193:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592761.094196:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0600, rc 0) 00000100:00100000:0.0:1788592761.094930:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209148928:12345-192.168.203.47@tcp:101:rm.0 Request processed in 1296us (2335us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788592761.094941:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:3.0:1788592761.113883:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592761.114177:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209149056 00000100:00100000:0.0:1788592761.114188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209149056 00000100:00100000:0.0:1788592761.114236:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:0.0:1788592761.114246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209149056:12345-192.168.203.47@tcp:41:rm.0 00000004:00000024:0.0:1788592761.114372:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788592761.114554:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209149056:12345-192.168.203.47@tcp:41:rm.0 Request processed in 308us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592761.114563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:3.0:1788592761.126167:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592761.126887:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209149184 00000100:00100000:2.0:1788592761.126899:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209149184 00000100:00100000:0.0:1788592761.127095:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:0.0:1788592761.127109:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209149184:12345-192.168.203.47@tcp:101:rm.0 00010000:00010000:0.0:1788592761.127130:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592761.127151:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d74 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127212:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127227:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127239:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127251:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127275:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127282:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127379:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127389:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127412:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592761.127448:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788592761.127452:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592761.127468:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127479:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127487:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127494:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127500:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127517:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592761.127522:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127530:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127552:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:0.0:1788592761.127555:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592761.127560:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127567:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db4f53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127581:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127587:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127592:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127597:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592761.127600:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127606:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127624:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9218765e0a00) 00010000:00010000:0.0:1788592761.127627:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592761.127630:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127636:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127660:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d74 expref: 20 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127673:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d74 expref: 19 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.127681:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:0.0:1788592761.127683:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592761.127685:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0800, rc 0) 00000100:00100000:0.0:1788592761.127755:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:10491:x1875475209149184:12345-192.168.203.47@tcp:101:rm.0 Request processed in 650us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592761.127763:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:1.0:1788592761.133049:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592761.133168:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209149440 00000100:00100000:0.0:1788592761.133178:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209149440 00000100:00100000:0.0:1788592761.133228:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:0.0:1788592761.133237:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:10491:x1875475209149440:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1788592761.133289:0:10029:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788592761.133325:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d74 expref: 19 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133370:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81600/0xbd314a3362db4f0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d58 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133383:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:0.0:1788592761.133642:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db4f22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d5f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133654:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:0.0:1788592761.133658:0:10029:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592761.133677:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133690:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133700:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133712:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133719:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133725:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133817:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133848:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.133856:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592761.134191:0:10029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788592761.134207:0:10029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 295381139251ns, next at 296381136384ns, rc = 0 00010000:00010000:0.0:1788592761.134252:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134260:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134267:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134276:0:10029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134282:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134287:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134366:0:10029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592761.134387:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134410:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134427:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134432:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592761.134437:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134445:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134453:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:0.0:1788592761.134456:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788592761.134460:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134465:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db4f76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134484:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134490:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134496:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134501:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592761.134504:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134520:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134528:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:0.0:1788592761.134531:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592761.134534:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134539:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db4f68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592761.134561:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006032a31a reply state 00000000700c8f49 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134571:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.134577:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9218765e0a00) 00010000:00010000:0.0:1788592761.134579:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592761.134582:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592761.134659:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209149440:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1421us (1617us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788592761.134667:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 38 00010000:00010000:2.0:1788592761.135961:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592761.135971:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.135980:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592761.135983:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.135992:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.136007:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:2.0:1788592761.136022:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788592761.136026:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.136033:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4f7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.136047:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592761.136049:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592761.136051:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592761.138151:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592761.138283:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209149696 00000100:00100000:0.0:1788592761.138308:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209149696 00000100:00100000:0.0:1788592761.138609:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:0.0:1788592761.138622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209149696:12345-192.168.203.47@tcp:35:rm.0 00000100:00100000:0.0:1788592761.138929:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:10491:x1875475209149696:12345-192.168.203.47@tcp:35:rm.0 Request processed in 309us (793us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788592761.138959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:1.0:1788592761.146438:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592761.146604:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209149952 00000100:00100000:0.0:1788592761.146618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209149952 00000100:00100000:0.0:1788592761.146738:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:0.0:1788592761.146751:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:10491:x1875475209149952:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:0.0:1788592761.146850:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788592761.146887:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db4f3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d6d expref: 19 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.146914:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db4edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d4a expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.146927:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921743723500) 00010000:00010000:0.0:1788592761.146957:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db4e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d3c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.146967:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723c00) 00010000:00010000:0.0:1788592761.146973:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592761.147007:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147022:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147033:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147047:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147111:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147118:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147229:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147238:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147245:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592761.147559:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788592761.147579:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147587:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147594:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147600:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592761.147605:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147614:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147636:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff921875ae0100) 00010000:00010000:0.0:1788592761.147639:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788592761.147644:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147651:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db4f92 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147674:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147680:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147686:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147690:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592761.147693:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147699:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147706:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0500) 00010000:00010000:0.0:1788592761.147708:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592761.147710:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147715:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db4f84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592761.147737:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac08e710 reply state 0000000012ebc5c5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147748:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.147754:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921875ae0400) 00010000:00010000:0.0:1788592761.147756:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592761.147759:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592761.147864:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:10491:x1875475209149952:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1112us (1582us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788592761.147872:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 39 00010000:00010000:2.0:1788592761.785627:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788592762.681617:0:10033:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296928546525ns, next at 297928543433ns, rc = 0 00000100:00100000:0.0:1788592762.681636:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592762.681660:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226002688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592762.681731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592762.682658:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002688 00000100:00100000:3.0:1788592762.682669:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002688 00000100:00100000:3.0:1788592762.682798:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788592762.682835:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226002688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592762.682863:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592762.683156:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226002688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 324us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592762.683165:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788592762.683254:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743992a00 x1875475226002688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592762.683276:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226002688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592762.683306:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226003072:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.683340:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226002816:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.683380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.683410:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226003328:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.683464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.683485:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226003840:0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.683491:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.683515:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592762.683533:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226003584:0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.683558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.683559:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788592762.683569:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226002944:0@lo:400:kworker.0 00000100:00080000:1.0:1788592762.683591:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592762.683610:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003328 00000100:00100000:0.0:1788592762.683611:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226004096:0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.683621:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003328 00000100:00100000:0.0:1788592762.683639:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592762.683664:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003584 00000100:00100000:1.0:1788592762.683668:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003584 00000100:00100000:0.0:1788592762.683668:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592762.683687:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226003200:0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.683696:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226004096 00000100:00100000:1.0:1788592762.683700:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226004096 00000100:00100000:0.0:1788592762.683720:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592762.683725:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788592762.683735:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226003328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.683743:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226003712:0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.683779:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226003328:12345-0@lo:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.683785:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788592762.683807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788592762.683813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226003584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.683855:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226003584:12345-0@lo:400:kworker.0 Request processed in 42us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.683863:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788592762.683870:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592762.683877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788592762.683886:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226004096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.683916:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226004096:12345-0@lo:400:kworker.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.683933:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788592762.683954:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003072 00000100:00100000:1.0:1788592762.683957:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003072 00000100:00100000:1.0:1788592762.683978:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003200 00000100:00100000:1.0:1788592762.683980:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003200 00000100:00100000:1.0:1788592762.683993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788592762.683998:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226003072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226003072:12345-0@lo:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.684034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788592762.684044:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788592762.684050:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226003200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684099:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226003200:12345-0@lo:400:kworker.0 Request processed in 49us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.684106:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788592762.684123:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592762.684157:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003840 00000100:00100000:1.0:1788592762.684161:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003840 00000100:00100000:1.0:1788592762.684196:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003712 00000100:00100000:1.0:1788592762.684200:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003712 00000100:00100000:1.0:1788592762.684217:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592762.684223:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226003840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684253:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226003840:12345-0@lo:400:kworker.0 Request processed in 30us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.684258:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592762.684268:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592762.684273:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226003712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684298:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226003712:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.684303:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788592762.684318:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592762.684372:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002816 00000100:00100000:1.0:1788592762.684376:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002816 00000100:00100000:1.0:1788592762.684401:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788592762.684407:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226002816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684438:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226002816:12345-0@lo:400:kworker.0 Request processed in 31us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.684444:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788592762.684478:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226004224:0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.684572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788592762.684610:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92187591dc00 x1875475226004096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592762.684621:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226004096:0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.684631:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226003072:0@lo:400:kworker.0 00010000:00080000:0.0:1788592762.684689:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921876657b80 x1875475226003584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592762.684699:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226003584:0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684708:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226004224 00000100:00100000:1.0:1788592762.684713:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226004224 00000100:00100000:0.0:1788592762.684732:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226003200:0@lo:400:kworker.0 00010000:00080000:0.0:1788592762.684745:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921876657480 x1875475226003712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592762.684749:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788592762.684760:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226003712:0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.684763:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226004224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788592762.684796:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592762.684809:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226004224:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.684826:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788592762.684830:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92187591c700 x1875475226004224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592762.684843:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226004224:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.686016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.686058:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226003456:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.686103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.686134:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226003968:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.686157:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592762.686191:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226002816:0@lo:400:kworker.0 00000100:00100000:2.0:1788592762.686208:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226003328:0@lo:400:kworker.0 00010000:00080000:2.0:1788592762.686241:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b53b80 x1875475226003840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592762.686253:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226003840:0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.686272:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226002944 00000100:00100000:0.0:1788592762.686287:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226002944 00000100:00100000:2.0:1788592762.686294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003456 00000100:00100000:2.0:1788592762.686300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003456 00000100:00100000:0.0:1788592762.686331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226003968 00000100:00100000:0.0:1788592762.686336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226003968 00000100:00100000:2.0:1788592762.686344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788592762.686355:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592762.686362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788592762.686371:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226003456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.686444:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788592762.686453:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226003968:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788592762.687163:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592762.688417:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226003456:12345-0@lo:400:kworker.0 Request processed in 2040us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592762.688430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788592762.690137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226002944:12345-0@lo:400:kworker.0 Request processed in 3777us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592762.690152:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788592762.690521:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226002944:0@lo:400:kworker.0 00000100:00100000:3.0:1788592762.690537:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226003456:0@lo:400:kworker.0 00000100:00100000:1.0:1788592762.691841:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226003968:12345-0@lo:400:kworker.0 Request processed in 5383us (5676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.691854:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788592762.691973:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226003968:0@lo:400:kworker.0 00010000:00010000:3.0:1788592762.810158:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592763.192939:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592763.193220:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592763.193544:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226004352 00000100:00100000:0.0:1788592763.193553:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226004352 00000100:00100000:0.0:1788592763.193609:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788592763.193619:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226004352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788592763.193651:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592763.193829:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226004352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 210us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592763.193836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788592763.193901:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743991180 x1875475226004352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592763.194012:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592763.704591:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226004480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592763.704665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592763.707655:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226004480 00000100:00100000:2.0:1788592763.707655:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592763.707666:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226004480 00000100:00100000:2.0:1788592763.707674:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226004608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592763.707724:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788592763.707729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592763.707733:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226004480:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592763.707796:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226004608 00000100:00100000:1.0:1788592763.707800:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226004608 00002000:00000024:3.0:1788592763.707825:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592763.707830:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788592763.707836:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226004608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592763.707845:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592763.707873:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226004608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592763.707885:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788592763.707920:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d8000 x1875475226004608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592763.707938:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226004608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592763.707987:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226004480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 255us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.707994:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788592763.708163:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875aba300 x1875475226004480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592763.708190:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226004480:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788592763.834479:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592764.838395:0:13672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788592764.857778:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592764.857907:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592764.857939:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592764.857962:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592764.857989:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592764.858020:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592764.858053:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150336 00000100:00100000:3.0:1788592764.858146:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150336 00000100:00100000:3.0:1788592764.858200:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150592 00000100:00100000:3.0:1788592764.858204:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150592 00000100:00100000:3.0:1788592764.858223:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150208 00000100:00100000:3.0:1788592764.858225:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150208 00000100:00100000:3.0:1788592764.858240:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150720 00000100:00100000:3.0:1788592764.858243:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150720 00010000:00010000:2.0:1788592764.858272:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592764.858297:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150464 00000100:00100000:2.0:1788592764.858302:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150464 00000100:00100000:2.0:1788592764.858336:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:2.0:1788592764.858346:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209150464:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592764.858411:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209150464:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 66us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592764.858419:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:3.0:1788592764.858573:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 180 00000100:00100000:3.0:1788592764.858587:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209150336:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592764.858621:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209150336:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.858699:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150080 00000100:00100000:1.0:1788592764.858704:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150080 00000100:00100000:1.0:1788592764.858731:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 329 00000100:00100000:1.0:1788592764.858738:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2393:x1875475209150080:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592764.858755:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 181 00000100:00100000:3.0:1788592764.858763:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 180 00000100:00100000:2.0:1788592764.858770:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209150592:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592764.858771:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2393:x1875475209150080:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 31us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.858784:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 329 00000100:00100000:2.0:1788592764.858825:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209150592:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 60us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592764.859134:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:3.0:1788592764.859145:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:2393:x1875475209150208:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592764.859175:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:2393:x1875475209150208:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 33us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.862083:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 183 00000100:00100000:1.0:1788592764.862107:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209150720:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592764.862191:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209150720:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 95us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.862199:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 183 00000100:00100000:2.0:1788592764.862737:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 181 00000100:00100000:3.0:1788592764.862747:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00080000:3.0:1788592764.862779:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592764.862785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592764.862788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1788592765.697754:0:13720:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc013ab280 20000000:00000080:3.0:1788592765.697771:0:13720:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921743b54c00 uarg=0000000000000000 20000000:01000000:3.0:1788592765.697830:0:13720:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788592765.697837:0:13720:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788592765.697842:0:13720:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788592765.698699:0:13721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788592765.698882:0:13720:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788592765.704606:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788592765.704649:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788592765.704668:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788592765.704689:0:13720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788592765.704710:0:13720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704727:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704751:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704757:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704764:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704773:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704779:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704786:0:13720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704839:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.704852:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 12 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.704866:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226004736:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592765.705027:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.705036:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 12 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.705053:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226004864:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592765.705127:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.705136:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 23 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.705145:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226004992:0@lo:104: 00000100:00100000:2.0:1788592765.705184:0:13720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788592765.705231:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.705239:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 23 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.705248:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226005120:0@lo:104: 00010000:00010000:2.0:1788592765.705273:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.705281:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.705289:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226005248:0@lo:104: 00010000:00010000:2.0:1788592765.705313:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.705321:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.705354:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226005376:0@lo:104: 00000100:00100000:2.0:1788592765.705515:0:13720:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592765.708263:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788592765.708307:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592765.708363:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592765.708562:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592765.708573:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226004992 00000100:00100000:3.0:1788592765.708580:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226004992 00000100:00100000:3.0:1788592765.708616:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005120 00000100:00100000:3.0:1788592765.708619:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005120 00000100:00100000:3.0:1788592765.708626:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005248 00000100:00100000:3.0:1788592765.708628:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005248 00000100:00100000:3.0:1788592765.708635:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005376 00000100:00100000:3.0:1788592765.708637:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005376 00000100:00100000:3.0:1788592765.708647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592765.708655:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876777050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:13720:x1875475226004992:12345-0@lo:104: 00010000:00010000:3.0:1788592765.708672:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.708783:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592765.708789:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876777050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+6:13720:x1875475226004992:12345-0@lo:104: Request processed in 135us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.708807:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592765.708846:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592765.708853:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13720:x1875475226005120:12345-0@lo:104: 00010000:00010000:3.0:1788592765.708861:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.708894:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592765.708899:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+5:13720:x1875475226005120:12345-0@lo:104: Request processed in 47us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.708905:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592765.708916:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592765.708921:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:13720:x1875475226005248:12345-0@lo:104: 00010000:00010000:3.0:1788592765.708936:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.708968:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788592765.708974:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+4:13720:x1875475226005248:12345-0@lo:104: Request processed in 53us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.708981:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592765.708993:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592765.708998:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:13720:x1875475226005376:12345-0@lo:104: 00010000:00010000:3.0:1788592765.709005:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.709030:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788592765.709034:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+3:13720:x1875475226005376:12345-0@lo:104: Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.709040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788592765.709061:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788592765.709100:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.709107:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592765.709111:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.709120:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592765.709126:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592765.709138:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592765.709170:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.709177:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592765.709346:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788592765.709352:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709358:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592765.709361:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709377:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592765.709383:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592765.709396:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592765.709416:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709421:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592765.709436:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709443:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db4e42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e49 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709456:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592765.709458:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709463:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592765.709466:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709472:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592765.709478:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592765.709483:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592765.709495:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709500:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592765.709512:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709518:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9217439f1600/0xbd314a3362db4e34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709526:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592765.709529:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709534:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80a00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592765.709537:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709543:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592765.709549:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592765.709555:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592765.709568:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.709573:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788592765.709953:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226004992:0@lo:104: 00000100:00100000:2.0:1788592765.709963:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226005120:0@lo:104: 00000100:00100000:2.0:1788592765.709970:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226005248:0@lo:104: 00000100:00100000:2.0:1788592765.709976:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226005376:0@lo:104: 00010000:00010000:2.0:1788592765.709998:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592765.710015:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226005504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.710061:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592765.710115:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592765.710121:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226005888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.710140:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592765.710163:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005504 00000100:00100000:2.0:1788592765.710167:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005504 00010000:00010000:2.0:1788592765.710193:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 24 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.713039:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.713056:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9217439f1a00/0xbd314a3362db4e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.713089:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592765.713091:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592765.713094:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592765.713499:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005888 00000100:00100000:2.0:1788592765.713508:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005888 00010000:00010000:2.0:1788592765.713542:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 25 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.713572:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788592765.713582:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+25:3642:x1875475226005504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592765.713598:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592765.713618:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 25 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.713629:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 25 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.713648:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f1400/0xbd314a3362db4e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4e50 expref: 25 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.713660:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592765.713726:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226005504:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592765.713733:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788592765.713748:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592765.713754:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3642:x1875475226005888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592765.713762:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592765.713766:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.713774:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.713784:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f0a00/0xbd314a3362db4e2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4e26 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.713792:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592765.713825:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3642:x1875475226005888:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592765.713832:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592765.713872:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226005888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.713894:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226005504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.713946:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226005760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.713980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592765.714011:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592765.714017:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226005632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.714034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592765.714057:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005760 00000100:00100000:2.0:1788592765.714060:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005760 00010000:00010000:2.0:1788592765.714100:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 22 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.714112:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226005632 00000100:00100000:2.0:1788592765.714114:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226005632 00010000:00010000:2.0:1788592765.714122:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 23 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.714132:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592765.714137:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3640:x1875475226005760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592765.714144:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592765.714148:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.714155:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.714165:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80400/0xbd314a3362db4e3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4e34 expref: 23 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.714183:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592765.714220:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3640:x1875475226005760:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592765.714226:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592765.714237:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592765.714243:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3640:x1875475226005632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592765.714249:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592765.714253:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 21 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.714261:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 21 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.714270:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80600/0xbd314a3362db4e49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db4e42 expref: 21 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.714277:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592765.714295:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3640:x1875475226005632:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592765.714300:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592765.714319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226005632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592765.714326:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226005760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592765.715411:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.715425:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80a00/0xbd314a3362db4e26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db4e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592765.715593:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592765.715625:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592765.715647:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150848 00000100:00100000:1.0:1788592765.715652:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150848 00010000:00010000:1.0:1788592765.715677:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 13 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592765.715699:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209150976 00000100:00100000:1.0:1788592765.715702:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209150976 00010000:00010000:1.0:1788592765.715712:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 14 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592765.715728:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:1.0:1788592765.715735:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fde4749-eba3-4045-af7c-c124eb85a251+14:2396:x1875475209150848:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592765.715747:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592765.715752:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 14 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715763:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 14 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715779:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592765.715832:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fde4749-eba3-4045-af7c-c124eb85a251+14:2396:x1875475209150848:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592765.715840:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:1.0:1788592765.715855:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:1.0:1788592765.715861:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209150976:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592765.715868:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592765.715883:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 13 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715893:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 13 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715905:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715926:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715943:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715950:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715958:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715965:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715971:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592765.715975:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715984:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.715992:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.716006:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592765.716025:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209150976:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 164us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592765.716032:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00010000:00010000:2.0:1788592765.716391:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f0c00/0xbd314a3362db4e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d2e expref: 12 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.716404:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226004736:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592765.716423:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f1c00/0xbd314a3362db4e5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d27 expref: 11 pid: 6504 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.716432:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875475226004864:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592765.716459:0:13720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.716469:0:13720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.716476:0:13720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.716482:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80e00/0xbd314a3362db4f99 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.721271:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592765.721277:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592765.721281:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592765.752836:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592765.752865:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226006016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592765.752928:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226006144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592765.752936:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592765.752973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592765.753022:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006016 00000100:00100000:3.0:1788592765.753030:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006016 00000100:00100000:0.0:1788592765.753036:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006144 00000100:00100000:0.0:1788592765.753042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006144 00000100:00100000:3.0:1788592765.753112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788592765.753128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226006016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788592765.753162:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788592765.753225:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226006016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.753232:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788592765.753253:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788592765.753258:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226006016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592765.753274:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226006144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592765.753299:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788592765.753378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226006144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.753387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788592765.753452:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226006144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788592765.880167:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788592766.369835:0:13770:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe617bf550 20000000:00000080:3.0:1788592766.369851:0:13770:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9218767b9000 uarg=0000000000000000 20000000:01000000:3.0:1788592766.369891:0:13770:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788592766.369897:0:13770:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788592766.369901:0:13770:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788592766.370635:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788592766.370781:0:13770:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788592766.370859:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788592766.371853:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788592766.371883:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788592766.371896:0:13770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788592766.371916:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371932:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371942:0:13770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371948:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371954:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371961:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371966:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ec00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592766.371978:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371987:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.371999:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.372008:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.372014:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205ec00/0xbd314a3362db4fa0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592766.379173:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788592766.379221:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:3.0:1788592766.379471:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226006272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788592766.379541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592766.379597:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006272 00000100:00100000:3.0:1788592766.379605:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006272 00000100:00100000:3.0:1788592766.379661:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592766.379671:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226006272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788592766.379700:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1788592766.379735:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9bc278, atime: 0x6a9bc278, ctime: 0x6a9bc278, blocks: 0x0 00010000:00010000:3.0:1788592766.379744:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.379760:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1788592766.379764:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592766.379771:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.379803:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.379814:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.379822:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.379837:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788592766.380041:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226006272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 371us (501us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788592766.380049:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788592766.380087:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788592766.380100:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592766.380106:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380115:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592766.380120:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380140:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380169:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380176:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db4fa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380193:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592766.380195:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592766.380196:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788592766.380226:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92187591c000/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788592766.380232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226006272:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788592766.380273:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380282:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380288:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380293:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592766.380297:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380303:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380313:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9218765e0a00) 00010000:00010000:3.0:1788592766.380323:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.380328:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380333:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db4ef1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380347:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380354:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380360:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380364:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592766.380367:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380372:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380378:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff921743723400) 00010000:00010000:3.0:1788592766.380380:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.380383:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380388:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db4f06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380400:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380414:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380419:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380424:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592766.380426:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380431:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380437:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9218765e0a00) 00010000:00010000:3.0:1788592766.380439:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.380441:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380446:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db4f6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380501:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380507:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380512:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380516:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592766.380523:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380529:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380535:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff921875ae0400) 00010000:00010000:3.0:1788592766.380537:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.380540:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.380545:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db4f8b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592766.380753:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788592766.904711:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592767.354182:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592767.358306:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151104 00000100:00100000:2.0:1788592767.358321:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151104 00000100:00100000:2.0:1788592767.358389:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 330 00000100:00100000:2.0:1788592767.358399:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+11:6162:x1875475209151104:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592767.358414:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592767.358433:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80e00/0xbd314a3362db4fae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d7b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.358474:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80e00/0xbd314a3362db4fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d7b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.358486:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80e00/0xbd314a3362db4fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d7b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.358495:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80e00, rc 0) 00000100:00100000:2.0:1788592767.358569:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209151104:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 171us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.358576:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 330 00000100:00100000:1.0:1788592767.366319:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592767.366436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151232 00000100:00100000:2.0:1788592767.366446:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151232 00000100:00100000:2.0:1788592767.366516:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 331 00000100:00100000:2.0:1788592767.366526:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209151232:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.366690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209151232:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.366698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 331 00000100:00100000:3.0:1788592767.370497:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592767.370708:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151360 00000100:00100000:1.0:1788592767.370733:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151360 00000100:00100000:1.0:1788592767.370807:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 332 00000100:00100000:1.0:1788592767.370819:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209151360:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.371133:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209151360:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 316us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.371141:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 332 00000100:00100000:1.0:1788592767.379116:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592767.379491:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151488 00000100:00100000:0.0:1788592767.379503:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151488 00000100:00100000:0.0:1788592767.379561:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 333 00000100:00100000:0.0:1788592767.379571:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+12:10775:x1875475209151488:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592767.379727:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+12:10775:x1875475209151488:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 157us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.379736:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 333 00000100:00100000:2.0:1788592767.390587:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592767.390976:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151616 00000100:00100000:1.0:1788592767.390987:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151616 00000100:00100000:1.0:1788592767.391057:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 334 00000100:00100000:1.0:1788592767.391096:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:10775:x1875475209151616:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592767.391702:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+12:10775:x1875475209151616:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 634us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.391722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 334 00000100:00100000:3.0:1788592767.411106:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592767.411211:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151744 00000100:00100000:2.0:1788592767.411221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151744 00000100:00100000:2.0:1788592767.411279:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 335 00000100:00100000:2.0:1788592767.411288:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+12:6162:x1875475209151744:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592767.411305:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592767.411323:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81a00/0xbd314a3362db4fb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d82 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.411384:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81a00/0xbd314a3362db4fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d82 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.411396:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81a00/0xbd314a3362db4fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d82 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.411723:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81a00, rc 0) 00000100:00100000:2.0:1788592767.411800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209151744:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 511us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.411807:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 335 10000000:01000000:2.0:1788592767.417239:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592767.417248:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174243f000 from 7 10000000:01000000:2.0:1788592767.417253:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592767.417302:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.417314:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.417325:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.417361:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f509500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226006400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.417432:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592767.417477:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.417576:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006400 00000100:00100000:1.0:1788592767.417583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006400 00000100:00100000:1.0:1788592767.417633:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788592767.417643:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:6509:x1875475226006400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592767.417656:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592767.417669:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742839c00/0xbd314a3362db4fc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4fbc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.417693:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742839c00/0xbd314a3362db4fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4fbc expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.417705:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742839c00/0xbd314a3362db4fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4fbc expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.417715:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839c00, rc 0) 00000100:00100000:1.0:1788592767.417769:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475226006400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.417776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788592767.417886:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f509500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226006400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592767.417901:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.417910:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592767.417969:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875abad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226006528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592767.417995:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.418021:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186b9b9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.418094:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006528 00000100:00100000:1.0:1788592767.418099:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006528 00000100:00100000:1.0:1788592767.418130:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788592767.418137:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475226006528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.418281:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475226006528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.418288:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788592767.418662:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875abad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226006528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.418698:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226006656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.418750:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.418781:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.418848:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006656 00000100:00100000:1.0:1788592767.418859:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006656 00000100:00100000:1.0:1788592767.418891:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788592767.418898:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475226006656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.418998:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:6509:x1875475226006656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.419005:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788592767.419330:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226006656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592767.419921:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13783:1875475226006784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592767.419970:0:13783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.420004:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186b9b9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.420064:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006784 00000100:00100000:1.0:1788592767.420094:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006784 00000100:00100000:1.0:1788592767.420174:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788592767.420183:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:13783:x1875475226006784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592767.420280:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:13783:x1875475226006784:12345-0@lo:502:llog_process_th.0 Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.420287:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788592767.420371:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13783:1875475226006784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592767.420394:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592767.420408:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.420410:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592767.420416:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92174243f000 00000020:00000080:0.0:1788592767.420419:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592767.420479:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592767.420482:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.420484:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592767.420486:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592767.420489:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.420490:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788592767.420494:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92174243f000 00000020:00000080:0.0:1788592767.420496:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788592767.420529:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13783:1875475226006912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592767.420564:0:13783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.424344:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592767.427668:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226006912 00000100:00100000:2.0:1788592767.427682:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226006912 00000100:00100000:2.0:1788592767.427744:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788592767.427769:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:13783:x1875475226006912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592767.427807:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186b9b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.428939:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:13783:x1875475226006912:12345-0@lo:502:llog_process_th.0 Request processed in 1169us (8371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.432032:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13783:1875475226006912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592767.432100:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592767.432109:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592767.432111:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788592767.432114:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788592767.432255:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788592767.432274:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592767.432284:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.432295:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592767.432304:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592767.432307:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218764b9000 from 7 10000000:01000000:1.0:1788592767.432317:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592767.432364:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.432373:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.432382:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592767.432640:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.432699:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592767.432737:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845029900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.432754:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007040 00000100:00100000:1.0:1788592767.432760:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007040 00000100:00100000:1.0:1788592767.432833:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788592767.432842:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475226007040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592767.432855:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592767.432867:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921742838000/0xbd314a3362db4fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4fca expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.432891:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921742838000/0xbd314a3362db4fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4fca expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.432901:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921742838000/0xbd314a3362db4fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4fca expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.432910:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838000, rc 0) 00000100:00100000:1.0:1788592767.432945:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226007040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.432961:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788592767.433002:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592767.433015:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.433023:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592767.433100:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.433124:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592767.433142:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba31540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.433152:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007168 00000100:00100000:1.0:1788592767.433156:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007168 00000100:00100000:1.0:1788592767.433172:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788592767.433178:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226007168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.433279:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226007168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.433286:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788592767.433313:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592767.433341:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.433737:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788592767.434823:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592767.434862:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba31540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592767.434884:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209151872 00000100:00100000:1.0:1788592767.434891:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209151872 00000100:00100000:1.0:1788592767.434921:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007296 00000100:00100000:1.0:1788592767.434931:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007296 00000100:00100000:1.0:1788592767.434952:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 343 00000100:00100000:1.0:1788592767.434960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209151872:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.435155:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788592767.435165:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475226007296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.435251:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475226007296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.435258:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788592767.435307:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.435728:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13786:1875475226007424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592767.435767:0:13786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592767.435801:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007424 00000100:00100000:2.0:1788592767.435805:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007424 00000100:00100000:2.0:1788592767.435825:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788592767.435831:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:13786:x1875475226007424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592767.435909:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:13786:x1875475226007424:12345-0@lo:502:llog_process_th.0 Request processed in 77us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.435915:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788592767.435951:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.435965:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13786:1875475226007424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788592767.435985:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592767.435994:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592767.435996:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788592767.436011:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9218764b9000 00000020:00000080:2.0:1788592767.436014:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788592767.436063:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592767.436094:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592767.436096:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788592767.436100:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592767.436103:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592767.436104:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788592767.436108:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9218764b9000 00000020:00000080:2.0:1788592767.436110:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788592767.436144:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13786:1875475226007552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592767.436177:0:13786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592767.436195:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007552 00000100:00100000:2.0:1788592767.436199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007552 00000100:00100000:2.0:1788592767.436215:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788592767.436220:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:13786:x1875475226007552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592767.436277:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:13786:x1875475226007552:12345-0@lo:502:llog_process_th.0 Request processed in 56us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.436284:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788592767.436309:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.436321:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13786:1875475226007552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788592767.436337:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592767.436341:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592767.436342:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788592767.436346:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:1.0:1788592767.436532:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209151872:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 1569us (12194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.436540:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 343 00000100:00100000:3.0:1788592767.438766:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592767.438810:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152000 00000100:00100000:3.0:1788592767.438819:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152000 00000100:00100000:3.0:1788592767.438861:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 347 00000100:00100000:3.0:1788592767.438872:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209152000:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.438999:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:6162:x1875475209152000:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 129us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.439013:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 347 00000020:01000000:2.0:1788592767.439561:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788592767.439595:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592767.439606:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.439629:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592767.439640:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592767.439642:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921875948800 from 7 10000000:01000000:2.0:1788592767.439645:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592767.439677:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.439685:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.439692:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.439713:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.439755:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592767.439798:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.439886:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007680 00000100:00100000:2.0:1788592767.439890:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007680 00000100:00100000:2.0:1788592767.439925:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788592767.439933:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:6509:x1875475226007680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592767.439943:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592767.439955:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80000/0xbd314a3362db4fdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4fd8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.439975:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80000/0xbd314a3362db4fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4fd8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.439997:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80000/0xbd314a3362db4fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4fd8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.440006:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80000, rc 0) 00000100:00100000:2.0:1788592767.440039:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226007680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.440045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788592767.440107:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592767.440119:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.440129:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.440178:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.440203:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592767.440217:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.440228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007808 00000100:00100000:2.0:1788592767.440232:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007808 00000100:00100000:2.0:1788592767.440249:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788592767.440255:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226007808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.440349:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226007808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.441810:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.441863:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.441918:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.441939:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592767.441957:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226007936 00000100:00100000:3.0:1788592767.441963:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226007936 00000100:00100000:3.0:1788592767.441993:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788592767.442000:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226007936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.442112:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226007936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.442119:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788592767.443323:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788592767.443634:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226007936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.449602:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13787:1875475226008064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592767.449773:0:13787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.449829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008064 00000100:00100000:3.0:1788592767.449837:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008064 00000100:00100000:3.0:1788592767.449881:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788592767.449890:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:13787:x1875475226008064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592767.450143:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:13787:x1875475226008064:12345-0@lo:502:llog_process_th.0 Request processed in 253us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.450152:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788592767.450200:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592767.450221:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13787:1875475226008064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592767.450441:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592767.450488:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152128 00000100:00100000:0.0:1788592767.450492:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152128 00000100:00100000:0.0:1788592767.450536:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 352 00000100:00100000:0.0:1788592767.450544:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:10779:x1875475209152128:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592767.450620:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:10779:x1875475209152128:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.450628:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 352 00000020:01000000:3.0:1788592767.453733:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592767.453748:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592767.453750:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592767.453757:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff921875948800 00000020:00000080:3.0:1788592767.453759:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592767.453832:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592767.453836:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592767.453837:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592767.453840:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592767.453842:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592767.453843:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788592767.453846:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff921875948800 00000020:00000080:3.0:1788592767.453848:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788592767.453905:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13787:1875475226008192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592767.455874:0:13787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.457481:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008192 00000100:00100000:2.0:1788592767.457491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592767.457508:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008192 00000100:00100000:3.0:1788592767.457574:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152256 00000100:00100000:3.0:1788592767.457578:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152256 00000100:00100000:3.0:1788592767.457605:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788592767.457615:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:13787:x1875475226008192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592767.457826:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:13787:x1875475226008192:12345-0@lo:502:llog_process_th.0 Request processed in 213us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.457834:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788592767.457897:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 354 00000100:00100000:3.0:1788592767.457904:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:10779:x1875475209152256:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788592767.458051:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:10779:x1875475209152256:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 147us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.458090:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 354 00000100:00100000:3.0:1788592767.458262:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592767.458283:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13787:1875475226008192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592767.458314:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592767.458321:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592767.458324:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788592767.458327:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788592767.458455:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788592767.458478:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592767.458488:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458498:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592767.458508:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788592767.458510:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921846c66000 from 7 10000000:01000000:3.0:1788592767.458513:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592767.458541:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458548:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458556:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592767.458574:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226008320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.458609:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.458633:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592767.458646:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008320 00000100:00100000:3.0:1788592767.458650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008320 00000100:00100000:3.0:1788592767.458669:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788592767.458676:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:6509:x1875475226008320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592767.458687:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592767.458697:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205f600/0xbd314a3362db4fed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db4fe6 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458718:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f600/0xbd314a3362db4fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db4fe6 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458726:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205f600/0xbd314a3362db4fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db4fe6 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458735:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f600, rc 0) 00000100:00100000:3.0:1788592767.458762:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186ba8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226008320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.458767:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788592767.458811:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226008320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592767.458823:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.458832:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592767.458876:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226008448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.458899:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.458918:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592767.458929:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008448 00000100:00100000:3.0:1788592767.458932:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008448 00000100:00100000:3.0:1788592767.458949:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788592767.458955:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226008448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.459042:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226008448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.459048:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788592767.459097:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226008448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.459136:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226008576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.459202:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.459215:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592767.459226:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008576 00000100:00100000:3.0:1788592767.459229:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008576 00000100:00100000:2.0:1788592767.459264:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788592767.459352:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226008576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592767.459420:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:6509:x1875475226008576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.459427:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000040:00080000:1.0:1788592767.459758:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788592767.463401:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:6509:1875475226008576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592767.464664:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13789:1875475226008704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592767.464743:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.464840:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742700a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.469203:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008704 00000100:00100000:2.0:1788592767.469219:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008704 00000100:00100000:2.0:1788592767.469651:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788592767.469664:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:13789:x1875475226008704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592767.469945:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:13789:x1875475226008704:12345-0@lo:502:llog_process_th.0 Request processed in 283us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.469953:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788592767.474337:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13789:1875475226008704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592767.474468:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592767.474496:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.474499:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592767.474506:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff921846c66000 00000020:00000080:0.0:1788592767.474510:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592767.474591:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592767.474595:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.474608:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592767.474612:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592767.474616:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.474617:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788592767.474620:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff921846c66000 00000020:00000080:0.0:1788592767.474623:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788592767.474694:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13789:1875475226008832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592767.474796:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.474839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008832 00000100:00100000:0.0:1788592767.474845:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008832 00000100:00100000:0.0:1788592767.474892:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788592767.474901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:13789:x1875475226008832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592767.475017:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:13789:x1875475226008832:12345-0@lo:502:llog_process_th.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.475025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788592767.475098:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186b9b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788592767.475113:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:13789:1875475226008832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592767.475133:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592767.475138:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592767.475140:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788592767.475143:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788592767.475999:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788592767.476029:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592767.476040:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.476052:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592767.480062:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788592767.800455:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226009344:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.800538:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226009216:0@lo:400:kworker.0 00000100:00100000:2.0:1788592767.800555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.800607:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226008960:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.800624:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226009088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592767.802619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.802675:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226009472:0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.802707:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.802730:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226009984:0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.802753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.802802:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226010496:0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.802826:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.802872:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009344 00000100:00100000:0.0:1788592767.802879:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009344 00000100:00100000:0.0:1788592767.802929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009472 00000100:00100000:0.0:1788592767.802932:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009472 00000100:00100000:0.0:1788592767.802949:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788592767.802956:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226009344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.803008:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226009344:12345-0@lo:400:kworker.0 Request processed in 52us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.803015:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788592767.803030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788592767.803035:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.803087:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226009472:12345-0@lo:400:kworker.0 Request processed in 52us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.803093:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788592767.803113:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009984 00000100:00100000:0.0:1788592767.803116:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009984 00000100:00100000:0.0:1788592767.803151:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010496 00000100:00100000:0.0:1788592767.803154:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010496 00000100:00100000:0.0:1788592767.803173:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788592767.803179:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226009984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.803209:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226009984:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.803215:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788592767.803226:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592767.803232:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226010496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.803268:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226010496:12345-0@lo:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.803274:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592767.803319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226009472:0@lo:400:kworker.0 00010000:00080000:0.0:1788592767.803333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b7800 x1875475226009984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592767.803342:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226009984:0@lo:400:kworker.0 00000100:00100000:0.0:1788592767.803356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226010496:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592767.803390:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226009600:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.803435:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009088 00000100:00100000:0.0:1788592767.803440:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009088 00000100:00100000:1.0:1788592767.803441:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226010112:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592767.803476:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788592767.803486:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226009088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592767.803495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226010624:0@lo:400:kworker.0 00002000:00000024:0.0:1788592767.803510:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592767.803532:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592767.803565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009600 00000100:00100000:1.0:1788592767.803570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009600 00000100:00100000:1.0:1788592767.803606:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788592767.803613:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226009600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803646:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226009600:12345-0@lo:400:kworker.0 Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.803652:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788592767.803668:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010112 00000100:00100000:1.0:1788592767.803675:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010112 00000100:00100000:1.0:1788592767.803691:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010624 00000100:00100000:1.0:1788592767.803693:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010624 00000100:00100000:1.0:1788592767.803716:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592767.803722:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226010112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803749:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226010112:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.803754:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592767.803762:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788592767.803767:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1875475226010624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803800:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1875475226010624:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.803804:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788592767.803827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226009600:0@lo:400:kworker.0 00010000:00080000:1.0:1788592767.803837:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b4380 x1875475226010112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592767.803846:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226010112:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803856:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226010624:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803913:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226008960 00000100:00100000:1.0:1788592767.803929:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226008960 00000100:00100000:1.0:1788592767.803956:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788592767.803962:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.803998:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226008960:12345-0@lo:400:kworker.0 Request processed in 36us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.804004:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788592767.804049:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226008960:0@lo:400:kworker.0 00000100:00080000:1.0:1788592767.804094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592767.804105:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592767.804368:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226009088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 883us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.804431:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788592767.804813:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226009344:0@lo:400:kworker.0 00000100:00100000:2.0:1788592767.804835:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226009856:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.804842:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592767.804873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.804882:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226009728:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.804903:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009216 00000100:00100000:2.0:1788592767.804906:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226010368:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.804916:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009216 00000100:00100000:2.0:1788592767.804960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.805107:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009856 00000100:00100000:3.0:1788592767.805112:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009856 00000100:00100000:3.0:1788592767.805141:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010368 00000100:00100000:3.0:1788592767.805144:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010368 00000100:00100000:3.0:1788592767.805159:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788592767.805166:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226009216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805205:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226009216:12345-0@lo:400:kworker.0 Request processed in 39us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.805210:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788592767.805236:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788592767.805243:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226009856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805271:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226009856:12345-0@lo:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.805277:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788592767.805288:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788592767.805294:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226010368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805321:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226010368:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.805326:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1788592767.805342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592767.805369:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.805388:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226009728 00000100:00100000:3.0:1788592767.805392:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226009728 00000100:00100000:3.0:1788592767.805415:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788592767.805421:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226009728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805449:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226009728:12345-0@lo:400:kworker.0 Request processed in 28us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.805462:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1788592767.805476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592767.805495:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226009728:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805502:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226010240:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805524:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592767.805542:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010240 00000100:00100000:3.0:1788592767.805544:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010240 00000100:00100000:3.0:1788592767.805568:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788592767.805574:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226010240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805602:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226010240:12345-0@lo:400:kworker.0 Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.805608:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1788592767.805621:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592767.805637:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226010240:0@lo:400:kworker.0 00000100:00100000:3.0:1788592767.805659:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226009216:0@lo:400:kworker.0 00010000:00080000:3.0:1788592767.805694:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b4700 x1875475226010368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592767.805703:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226010368:0@lo:400:kworker.0 00010000:00080000:3.0:1788592767.805720:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217437d2a00 x1875475226009856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592767.805727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226009856:0@lo:400:kworker.0 00000100:00100000:1.0:1788592767.806986:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226009088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788592767.928256:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592768.312521:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226010752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592768.312603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592768.312805:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010752 00000100:00100000:1.0:1788592768.312812:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010752 00000100:00100000:1.0:1788592768.312862:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788592768.312870:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226010752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592768.312889:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592768.316966:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226010752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592768.319137:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226010752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6259us (6525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592768.319152:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000040:00080000:1.0:1788592768.504967:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788592768.507620:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788592768.824400:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226010880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592768.824474:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592768.824571:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226010880 00000100:00100000:0.0:1788592768.824580:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226010880 00000100:00100000:0.0:1788592768.824633:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788592768.824643:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226010880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592768.824671:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592768.824794:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226010880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592768.824801:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788592768.824929:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592768.824940:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592768.824971:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788592768.825009:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921875ab8000 x1875475226010880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592768.825028:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226010880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592768.825053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011008 00000100:00100000:0.0:1788592768.825060:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011008 00000100:00100000:0.0:1788592768.825133:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788592768.825140:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226011008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592768.825152:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592768.826104:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226011008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 960us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592768.826114:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788592768.826428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743a90700 x1875475226011008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592768.826447:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226011008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788592768.952313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592769.974899:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592769.974963:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592769.975095:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592769.975129:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592769.975146:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592769.975179:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592769.975184:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152768 00000100:00100000:2.0:1788592769.975195:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152768 00000100:00100000:3.0:1788592769.975211:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152512 00000100:00100000:3.0:1788592769.975217:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152512 00000100:00100000:3.0:1788592769.975258:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152640 00000100:00100000:3.0:1788592769.975261:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152640 00000100:00100000:2.0:1788592769.975266:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:2.0:1788592769.975279:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209152768:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592769.975280:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153024 00000100:00100000:3.0:1788592769.975284:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153024 00000100:00100000:3.0:1788592769.975300:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152896 00000100:00100000:3.0:1788592769.975304:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152896 00000100:00100000:3.0:1788592769.975322:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 190 00000100:00100000:3.0:1788592769.975331:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209152512:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592769.975355:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209152768:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592769.975369:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209152512:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592769.975369:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:3.0:1788592769.975381:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 190 00000100:00100000:2.0:1788592769.975403:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 191 00000100:00100000:2.0:1788592769.975412:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209152640:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592769.975445:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209152640:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.975852:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209152384 00000100:00100000:1.0:1788592769.975858:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209152384 00000100:00100000:1.0:1788592769.975887:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 361 00000100:00100000:1.0:1788592769.975895:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209152384:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592769.975924:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209152384:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.975931:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 361 00000100:00100000:3.0:1788592769.976785:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:2.0:1788592769.976818:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 191 00000100:00100000:2.0:1788592769.976847:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 193 00000100:00100000:2.0:1788592769.976858:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209152896:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592769.976899:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209152896:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 44us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592769.976906:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 193 00000100:00080000:2.0:1788592769.976962:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592769.976967:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592769.976970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592769.977025:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209153024:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592769.977105:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209153024:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 85us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592769.977112:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 192 00010000:00010000:1.0:1788592769.977320:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592770.872344:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592770.872368:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226011136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592770.872438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592770.872804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011136 00000100:00100000:1.0:1788592770.872824:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011136 00000100:00100000:1.0:1788592770.872920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788592770.872930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226011136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592770.872962:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788592770.873028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226011136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592770.873038:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788592770.873090:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226011136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592770.873472:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226011264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592770.873506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592770.876873:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011264 00000100:00100000:3.0:1788592770.876888:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011264 00000100:00100000:3.0:1788592770.876936:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788592770.876946:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226011264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592770.877012:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788592770.877112:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226011264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592770.877119:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788592770.877497:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226011264:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788592771.000225:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788592771.900466:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788592772.024397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592772.920415:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592772.920441:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226011392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592772.920518:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592772.920571:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011392 00000100:00100000:0.0:1788592772.920578:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011392 00000100:00100000:0.0:1788592772.920640:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788592772.920649:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226011392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592772.920679:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592772.920721:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226011392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592772.920728:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788592772.920829:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788592772.920835:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92187591c000, transno 4294967301 00000100:00100000:0.0:1788592772.920852:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226011392:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788592772.921037:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592772.922281:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226011776:0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.922343:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592772.922387:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226012288:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.922389:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011776 00000100:00100000:3.0:1788592772.922398:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011776 00000100:00100000:2.0:1788592772.922420:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592772.922454:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788592772.922464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012288 00000100:00100000:3.0:1788592772.922465:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226011776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.922471:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012288 00000100:00100000:3.0:1788592772.922525:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226011776:12345-0@lo:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592772.922536:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788592772.922541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788592772.922552:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226012288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.922571:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226012800:0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.922591:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226012288:12345-0@lo:400:kworker.0 Request processed in 40us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592772.922598:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788592772.922608:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592772.922618:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592772.922632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012800 00000100:00100000:2.0:1788592772.922636:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012800 00000100:00100000:0.0:1788592772.922785:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226011520:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.922803:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226011776:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.922830:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592772.922922:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226012032:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.922947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592772.922969:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226012544:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.922993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592772.923013:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592772.923019:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226011648:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.923041:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788592772.923248:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f515f80 x1875475226012288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592772.923260:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226012288:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.923273:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012032 00000100:00100000:3.0:1788592772.923276:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012032 00000100:00100000:0.0:1788592772.923423:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226012160:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.923463:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592772.923477:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226012672:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.923603:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011648 00000100:00100000:3.0:1788592772.923607:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011648 00000100:00100000:3.0:1788592772.923626:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012160 00000100:00100000:3.0:1788592772.923629:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012160 00000100:00100000:1.0:1788592772.923668:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011520 00000100:00100000:1.0:1788592772.923674:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011520 00000100:00100000:1.0:1788592772.923706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788592772.923714:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226011520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.923788:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592772.923833:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012672 00000100:00100000:2.0:1788592772.923838:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012672 00000100:00100000:2.0:1788592772.923872:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788592772.923896:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226012800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592772.924114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226011520:12345-0@lo:400:kworker.0 Request processed in 399us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592772.924123:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788592772.924133:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226011520:0@lo:400:kworker.0 00000100:00100000:1.0:1788592772.924169:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012544 00000100:00100000:1.0:1788592772.924175:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012544 00000100:00100000:0.0:1788592772.924188:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788592772.924199:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226012032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592772.924218:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788592772.924219:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788592772.924230:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226012544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.924236:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226011648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.924248:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226012032:12345-0@lo:400:kworker.0 Request processed in 51us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592772.924256:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788592772.924278:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788592772.924284:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226011648:12345-0@lo:400:kworker.0 Request processed in 54us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592772.924287:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475226012672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.924304:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788592772.924323:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788592772.924332:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226012160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.924339:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475226012672:12345-0@lo:400:kworker.0 Request processed in 52us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592772.924346:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788592772.924378:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226012160:12345-0@lo:400:kworker.0 Request processed in 48us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592772.924382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226011648:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.924391:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788592772.924400:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226012160:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.924411:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226012672:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.924422:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226012032:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.924440:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788592772.924456:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226011904:0@lo:400:kworker.0 00000100:00100000:3.0:1788592772.924495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592772.924531:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226012416:0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.924539:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226011904 00000100:00100000:0.0:1788592772.924544:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226011904 00000100:00100000:1.0:1788592772.924551:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226012544:12345-0@lo:400:kworker.0 Request processed in 321us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592772.924560:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788592772.924567:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592772.924595:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012416 00000100:00100000:1.0:1788592772.924600:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012416 00000100:00100000:1.0:1788592772.924631:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788592772.924649:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226012416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592772.924684:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226012416:12345-0@lo:400:kworker.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592772.924700:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1788592772.924734:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f514380 x1875475226012544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592772.924757:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226012544:0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.924903:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226012800:12345-0@lo:400:kworker.0 Request processed in 771us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592772.924912:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1788592772.924934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592772.924939:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592772.924941:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788592772.924972:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f517800 x1875475226012416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592772.924982:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226012416:0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.924989:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226012928:0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.925015:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592772.925331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788592772.925343:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226011904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592772.925384:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226011904:12345-0@lo:400:kworker.0 Request processed in 45us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592772.925391:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788592772.926149:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226012928 00000100:00100000:1.0:1788592772.926158:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226012928 00000100:00100000:1.0:1788592772.926223:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788592772.926231:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226012928:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788592772.926269:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f516680 x1875475226012800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592772.926277:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226012928:12345-0@lo:400:kworker.0 Request processed in 45us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592772.926289:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788592772.926291:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226012800:0@lo:400:kworker.0 00000100:00100000:2.0:1788592772.926322:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226011904:0@lo:400:kworker.0 00000100:00080000:3.0:1788592772.926326:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592772.926338:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226012928:0@lo:400:kworker.0 00010000:00010000:1.0:1788592773.048237:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592773.433207:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226013056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592773.433281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592773.433421:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013056 00000100:00100000:0.0:1788592773.433429:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013056 00000100:00100000:0.0:1788592773.433485:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788592773.433493:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226013056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788592773.433523:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592773.438878:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226013056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5377us (5588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592773.438894:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788592773.439359:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226013056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592773.944310:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592773.944333:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592773.944421:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592773.944490:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013184 00000100:00100000:3.0:1788592773.944499:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013184 00000100:00100000:3.0:1788592773.944614:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788592773.944625:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226013184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592773.944655:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592773.944722:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226013184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592773.944729:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788592773.944815:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743a91c00 x1875475226013184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592773.944835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592773.946407:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592773.946424:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226013312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592773.946481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592773.946585:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013312 00000100:00100000:0.0:1788592773.946591:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013312 00000100:00100000:0.0:1788592773.946634:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788592773.946641:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226013312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592773.946658:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592773.946700:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226013312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592773.946713:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1788592773.946831:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b4700 x1875475226013312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592773.946847:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226013312:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788592774.072249:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592775.096572:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592775.097684:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592775.097746:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592775.097830:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592775.097890:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153152 00000100:00100000:1.0:1788592775.097900:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153152 00000100:00100000:1.0:1788592775.097959:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 363 00000100:00100000:1.0:1788592775.097969:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209153152:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592775.098044:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209153152:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 76us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592775.098051:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 363 00000100:00100000:2.0:1788592775.100371:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592775.100597:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153408 00000100:00100000:0.0:1788592775.100608:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153408 00000100:00100000:0.0:1788592775.100684:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153664 00000100:00100000:0.0:1788592775.100688:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153664 00000100:00100000:0.0:1788592775.100714:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:0.0:1788592775.100724:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209153408:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592775.100814:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209153408:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 91us (3066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592775.100821:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:0.0:1788592775.100839:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 201 00000100:00100000:0.0:1788592775.100845:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209153664:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592775.100870:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209153664:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592775.100875:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 201 00000100:00080000:1.0:1788592775.101352:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592775.101357:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592775.101520:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592775.101553:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592775.101740:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153536 00000100:00100000:1.0:1788592775.101745:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153536 00000100:00100000:1.0:1788592775.101803:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:1.0:1788592775.101811:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209153536:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592775.101850:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209153536:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592775.101856:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:0.0:1788592775.102045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153280 00000100:00100000:0.0:1788592775.102050:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153280 00000100:00100000:0.0:1788592775.102113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153792 00000100:00100000:0.0:1788592775.102117:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153792 00000100:00100000:0.0:1788592775.102135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 202 00000100:00100000:0.0:1788592775.102142:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209153280:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592775.102187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209153280:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 45us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592775.102194:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 202 00000100:00100000:0.0:1788592775.102207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 203 00000100:00100000:0.0:1788592775.102213:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209153792:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592775.102235:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209153792:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 22us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592775.102240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 203 00000100:00080000:2.0:1788592775.103327:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592775.103346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592775.103350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592775.994490:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226013440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592775.994561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592775.994880:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013440 00000100:00100000:2.0:1788592775.994889:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013440 00000100:00100000:2.0:1788592775.994956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788592775.994966:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226013440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592775.995001:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592775.995058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226013440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592775.995083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788592775.995165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226013440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592775.995460:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226013568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592775.995504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592775.995625:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013568 00000100:00100000:0.0:1788592775.995630:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013568 00000100:00100000:0.0:1788592775.995665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788592775.995672:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226013568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592775.995691:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592775.995744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226013568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592775.995751:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788592775.995918:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226013568:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788592776.121100:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592777.145364:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592778.041043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226013696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592778.041142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592778.041527:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013696 00000100:00100000:2.0:1788592778.041536:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013696 00000100:00100000:2.0:1788592778.041600:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592778.041611:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226013696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592778.041644:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592778.041787:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226013696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592778.041796:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592778.041850:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226013824:0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.041859:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226013696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592778.041886:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226014208:0@lo:400:kworker.0 00000100:00100000:2.0:1788592778.041894:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592778.041937:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226014080:0@lo:400:kworker.0 00000100:00100000:2.0:1788592778.041939:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226014336:0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.041944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592778.041981:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226014720:0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.041990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592778.041993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592778.042021:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226014592:0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.042022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592778.042063:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226015232:0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.042090:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592778.042116:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226015104:0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.042122:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592778.042149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592778.042158:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014208 00000100:00100000:0.0:1788592778.042163:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014208 00000100:00100000:3.0:1788592778.042186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014080 00000100:00100000:3.0:1788592778.042191:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014080 00000100:00100000:2.0:1788592778.042288:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226014848:0@lo:400:kworker.0 00000100:00100000:2.0:1788592778.042316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592778.044262:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788592778.044285:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226014208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.044374:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226014208:12345-0@lo:400:kworker.0 Request processed in 100us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592778.044381:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788592778.044400:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788592778.044407:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226014080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.044445:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226014080:12345-0@lo:400:kworker.0 Request processed in 39us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592778.044452:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788592778.045518:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592778.045562:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475226013952:0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.045619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592778.045652:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475226014464:0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.045692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592778.045723:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475226014976:0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.045745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592778.045856:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014336 00000100:00100000:0.0:1788592778.045866:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014336 00000100:00100000:0.0:1788592778.045914:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014592 00000100:00100000:0.0:1788592778.045917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014592 00000100:00100000:0.0:1788592778.045939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015104 00000100:00100000:0.0:1788592778.045951:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015104 00000100:00100000:0.0:1788592778.045965:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013952 00000100:00100000:0.0:1788592778.045968:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013952 00000100:00100000:0.0:1788592778.045978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014464 00000100:00100000:0.0:1788592778.045980:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014464 00000100:00100000:3.0:1788592778.047386:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788592778.047404:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226014336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.047419:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014720 00000100:00100000:1.0:1788592778.047428:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014720 00000100:00100000:1.0:1788592778.047470:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015232 00000100:00100000:1.0:1788592778.047474:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015232 00000100:00100000:3.0:1788592778.047482:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226014336:12345-0@lo:400:kworker.0 Request processed in 83us (5493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.047491:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788592778.047497:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014848 00000100:00100000:1.0:1788592778.047501:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014848 00000100:00100000:3.0:1788592778.047515:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788592778.047521:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788592778.047526:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226014592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.047534:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226014720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.047562:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226014592:12345-0@lo:400:kworker.0 Request processed in 40us (5473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.047569:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788592778.047585:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226014720:12345-0@lo:400:kworker.0 Request processed in 54us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.047587:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788592778.047599:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788592778.047600:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.047618:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788592778.047626:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226015232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.047638:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226015104:12345-0@lo:400:kworker.0 Request processed in 40us (5488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.047645:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788592778.047662:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788592778.047669:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475226013952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.047745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226014976 00000100:00100000:0.0:1788592778.047751:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226014976 00000100:00100000:0.0:1788592778.047780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788592778.047787:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475226014464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592778.047837:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226014336:0@lo:400:kworker.0 00000100:00100000:2.0:1788592778.047884:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226013824 00000100:00100000:2.0:1788592778.047888:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226013824 00000100:00100000:2.0:1788592778.047995:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788592778.048002:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226013824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.048316:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226015232:12345-0@lo:400:kworker.0 Request processed in 691us (6196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592778.048323:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788592778.048494:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788592778.048502:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226014848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.052792:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475226013952:12345-0@lo:400:kworker.0 Request processed in 5111us (7161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.052809:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788592778.052862:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788592778.052875:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475226014976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.052931:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875475226014976:12345-0@lo:400:kworker.0 Request processed in 62us (7185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.052937:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788592778.052987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475226013952:0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.053000:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1875475226014976:0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.053036:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226014080:0@lo:400:kworker.0 00010000:00080000:3.0:1788592778.053051:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743bcbb80 x1875475226014592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592778.053062:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226014592:0@lo:400:kworker.0 00010000:00080000:3.0:1788592778.053090:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f514380 x1875475226015104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592778.053099:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226015104:0@lo:400:kworker.0 00000100:00080000:3.0:1788592778.053160:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592778.053166:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592778.053169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592778.053172:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788592778.053217:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f516d80 x1875475226014720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592778.053227:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226014720:0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.053238:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226015232:0@lo:400:kworker.0 00000100:00100000:2.0:1788592778.054616:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226013824:12345-0@lo:400:kworker.0 Request processed in 6608us (12720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592778.054629:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788592778.055707:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226014208:0@lo:400:kworker.0 00000100:00100000:3.0:1788592778.055814:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226013824:0@lo:400:kworker.0 00000100:00100000:1.0:1788592778.057548:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226014848:12345-0@lo:400:kworker.0 Request processed in 9040us (15225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592778.057576:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788592778.057826:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f516680 x1875475226014848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592778.057841:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226014848:0@lo:400:kworker.0 00000100:00100000:0.0:1788592778.063278:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475226014464:12345-0@lo:400:kworker.0 Request processed in 15483us (17577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592778.063307:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788592778.064529:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475226014464:0@lo:400:kworker.0 00010000:00010000:0.0:1788592778.168397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592778.552459:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592778.552482:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226015360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592778.552548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592778.552734:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015360 00000100:00100000:3.0:1788592778.552743:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015360 00000100:00100000:3.0:1788592778.552793:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788592778.552802:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226015360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592778.552822:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592778.552878:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226015360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592778.552884:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788592778.553140:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226015360:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788592778.745475:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788592778.746868:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788592779.064419:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226015488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592779.064494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592779.064540:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015488 00000100:00100000:3.0:1788592779.064550:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015488 00000100:00100000:1.0:1788592779.065508:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226015616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592779.065550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592779.065623:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015616 00000100:00100000:0.0:1788592779.065629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015616 00000100:00100000:0.0:1788592779.065666:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788592779.065675:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226015616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592779.065716:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592779.065865:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226015616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592779.065874:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788592779.065884:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226015488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592779.065896:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788592779.065958:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b6300 x1875475226015616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592779.065976:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226015616:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788592779.066329:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743a91500 x1875475226015488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592779.066344:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226015488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592779.066835:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788592779.067316:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226015488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1432us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592779.067325:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00010000:1.0:1788592779.192295:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592780.214865:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592780.214950:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592780.215003:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592780.215120:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209153920 00000100:00100000:1.0:1788592780.215130:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209153920 00000100:00100000:1.0:1788592780.215187:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 365 00000100:00100000:1.0:1788592780.215198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209153920:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592780.215278:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209153920:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 83us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.215286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 365 00000100:00100000:0.0:1788592780.215534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154176 00000100:00100000:0.0:1788592780.215539:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154176 00000100:00100000:0.0:1788592780.215584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154048 00000100:00100000:0.0:1788592780.215587:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154048 00000100:00100000:0.0:1788592780.215607:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 210 00000100:00100000:0.0:1788592780.215614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209154176:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592780.215652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209154176:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592780.215659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 210 00000100:00100000:0.0:1788592780.215672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 211 00000100:00100000:0.0:1788592780.215679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209154048:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592780.215714:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209154048:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592780.215737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 211 00000100:00080000:1.0:1788592780.215861:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592780.215865:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788592780.216161:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592780.225866:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592780.225952:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592780.225999:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592780.226103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154432 00000100:00100000:1.0:1788592780.226112:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154432 00000100:00100000:1.0:1788592780.226186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154560 00000100:00100000:1.0:1788592780.226189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154560 00000100:00100000:1.0:1788592780.226211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 212 00000100:00100000:1.0:1788592780.226221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209154432:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592780.226311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209154432:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.226341:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 212 00000100:00100000:1.0:1788592780.226358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 213 00000100:00100000:1.0:1788592780.226364:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209154560:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592780.226400:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209154560:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.226406:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 213 00000100:00080000:2.0:1788592780.226761:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592780.226766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592780.227914:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154304 00000100:00100000:3.0:1788592780.227924:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154304 00000100:00100000:3.0:1788592780.228005:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:3.0:1788592780.228027:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2392:x1875475209154304:12345-192.168.203.47@tcp:9:kworker.0 00000020:00000080:3.0:1788592780.228051:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4f14 00000100:00080000:3.0:1788592780.228060:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9217439bd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592780.228121:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788592780.228291:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+2:2392:x1875475209154304:12345-192.168.203.47@tcp:9:kworker.0 Request processed in 266us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592780.228298:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00010000:00010000:3.0:1788592780.228323:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592780.228351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592781.112302:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592781.112326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226015744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592781.112360:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592781.112374:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226015872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592781.112405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592781.112449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592781.112498:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015744 00000100:00100000:0.0:1788592781.112506:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015744 00000100:00100000:0.0:1788592781.112554:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226015872 00000100:00100000:0.0:1788592781.112557:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226015872 00000100:00100000:0.0:1788592781.112572:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788592781.112580:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226015744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592781.112611:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592781.112655:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226015744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592781.112662:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788592781.112679:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788592781.112685:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226015872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788592781.112714:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788592781.112765:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226015872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592781.112771:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788592781.112812:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226015872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592781.112814:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226015744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788592781.241055:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592782.264868:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592783.160583:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592783.160608:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226016000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592783.160693:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592783.160909:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016000 00000100:00100000:0.0:1788592783.160918:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016000 00000100:00100000:0.0:1788592783.160986:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592783.160997:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226016000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592783.161042:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592783.161131:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226016000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592783.161140:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788592783.161355:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592783.161395:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226016000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592783.161886:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226016512:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.161923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592783.161955:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226017024:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.161979:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592783.161999:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226017536:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.162021:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592783.162039:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788592783.162045:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226016384:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.162092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592783.162272:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017024 00000100:00100000:2.0:1788592783.162288:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017024 00000100:00100000:2.0:1788592783.162331:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017536 00000100:00100000:2.0:1788592783.162334:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017536 00000100:00100000:2.0:1788592783.162356:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788592783.162363:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226017024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592783.162405:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226017024:12345-0@lo:400:kworker.0 Request processed in 43us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592783.162412:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788592783.162425:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788592783.162430:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226017536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592783.162474:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226017536:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592783.162479:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788592783.162499:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592783.162503:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592783.162528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016512 00000100:00100000:2.0:1788592783.162531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016512 00000100:00100000:2.0:1788592783.162552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016384 00000100:00100000:2.0:1788592783.162554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016384 00000100:00100000:2.0:1788592783.162565:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788592783.162570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226016512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592783.162602:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226016512:12345-0@lo:400:kworker.0 Request processed in 31us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592783.162608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788592783.162618:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788592783.162623:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226016384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592783.162657:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226016384:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592783.162673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788592783.162951:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226016384:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.162961:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226016896:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.163001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592783.163036:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226017408:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.163056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592783.163818:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226016512:0@lo:400:kworker.0 00010000:00080000:1.0:1788592783.163847:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217438a8000 x1875475226017024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592783.163858:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226017024:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.163869:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226017536:0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.163911:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016896 00000100:00100000:1.0:1788592783.163916:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016896 00000100:00100000:1.0:1788592783.163963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017408 00000100:00100000:1.0:1788592783.163966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017408 00000100:00100000:1.0:1788592783.163988:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788592783.163995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226016896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.164048:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226016896:12345-0@lo:400:kworker.0 Request processed in 53us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592783.164054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788592783.164094:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788592783.164100:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226017408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592783.164148:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226017408:12345-0@lo:400:kworker.0 Request processed in 49us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592783.164153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788592783.164347:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226016256:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.164403:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226016768:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.164457:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226017280:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.164493:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788592783.164500:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226016128:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.164547:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226016640:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.164577:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217438a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226017152:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164597:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.164621:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016256 00000100:00100000:3.0:1788592783.164625:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016256 00000100:00100000:3.0:1788592783.164642:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016768 00000100:00100000:3.0:1788592783.164656:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016768 00000100:00100000:3.0:1788592783.164672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017280 00000100:00100000:3.0:1788592783.164674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017280 00000100:00100000:3.0:1788592783.164698:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016640 00000100:00100000:3.0:1788592783.164701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016640 00000100:00100000:3.0:1788592783.164715:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788592783.164719:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226016256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164754:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226016256:12345-0@lo:400:kworker.0 Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592783.164759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788592783.164773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788592783.164779:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226016768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164804:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226016768:12345-0@lo:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592783.164809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788592783.164819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788592783.164825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226017280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164849:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226017280:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592783.164854:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788592783.164866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788592783.164871:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226016640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164897:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226016640:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592783.164902:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788592783.164932:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226016640:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164953:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226016256:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164961:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226016768:0@lo:400:kworker.0 00000100:00100000:3.0:1788592783.164969:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226017280:0@lo:400:kworker.0 00000100:00080000:3.0:1788592783.165011:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592783.165015:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788592783.165039:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743a91500 x1875475226016896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592783.165050:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226016896:0@lo:400:kworker.0 00010000:00080000:3.0:1788592783.165061:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217438aaa00 x1875475226017408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592783.165095:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226017408:0@lo:400:kworker.0 00000100:00100000:2.0:1788592783.165596:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226016128 00000100:00100000:2.0:1788592783.165602:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226016128 00000100:00100000:2.0:1788592783.165641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788592783.165649:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226016128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592783.165727:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226016128:12345-0@lo:400:kworker.0 Request processed in 79us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592783.165735:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788592783.166447:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017152 00000100:00100000:0.0:1788592783.166454:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017152 00000100:00100000:0.0:1788592783.166507:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592783.166516:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226017152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592783.166565:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226017152:12345-0@lo:400:kworker.0 Request processed in 50us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592783.166571:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788592783.166748:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226016128:0@lo:400:kworker.0 00010000:00080000:3.0:1788592783.166763:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217438a9c00 x1875475226017152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592783.166772:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217438a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226017152:0@lo:400:kworker.0 00000100:00080000:2.0:1788592783.166835:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788592783.289092:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592783.672390:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592783.672416:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226017664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592783.672491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592783.672693:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017664 00000100:00100000:3.0:1788592783.672701:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017664 00000100:00100000:3.0:1788592783.672763:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788592783.672774:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226017664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592783.672799:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592783.672847:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226017664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592783.672862:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788592783.673115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226017664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592784.184500:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226017792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592784.184565:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226017920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592784.184578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592784.184603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592784.184640:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017792 00000100:00100000:1.0:1788592784.184648:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017792 00000100:00100000:1.0:1788592784.184717:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226017920 00000100:00100000:1.0:1788592784.184721:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226017920 00000100:00100000:1.0:1788592784.184735:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788592784.184743:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226017792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592784.184770:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592784.184815:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226017792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592784.184822:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788592784.184840:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788592784.184846:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226017920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592784.184856:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788592784.184878:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b51500 x1875475226017792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592784.184883:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226017920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592784.184889:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788592784.184898:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226017792:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788592784.184912:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b4000 x1875475226017920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592784.184924:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226017920:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788592784.312318:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592785.335393:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592785.335438:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592785.335473:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592785.335509:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592785.335532:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592785.335561:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154944 00000100:00100000:2.0:1788592785.335570:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154944 00000100:00100000:3.0:1788592785.335699:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154688 00000100:00100000:3.0:1788592785.335704:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154688 00000100:00100000:0.0:1788592785.335716:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155200 00000100:00100000:0.0:1788592785.335723:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155200 00000100:00100000:3.0:1788592785.335765:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 367 00000100:00100000:3.0:1788592785.335778:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209154688:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592785.335779:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209154816 00000100:00100000:0.0:1788592785.335784:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209154816 00000100:00100000:0.0:1788592785.335801:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155072 00000100:00100000:0.0:1788592785.335803:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155072 00000100:00100000:0.0:1788592785.335822:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 220 00000100:00100000:0.0:1788592785.335830:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209155200:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592785.335856:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209154688:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 81us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592785.335865:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 367 00000100:00100000:0.0:1788592785.335875:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209155200:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 44us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592785.335883:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 220 00000100:00100000:0.0:1788592785.335900:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 221 00000100:00100000:0.0:1788592785.335906:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209154816:12345-192.168.203.47@tcp:400:kworker.0 00000100:00080000:3.0:1788592785.335917:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592785.335923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592785.335934:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209154816:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592785.335959:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 221 00000100:00100000:0.0:1788592785.335972:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 222 00000100:00100000:0.0:1788592785.335978:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209155072:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592785.336004:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209155072:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592785.336010:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 222 00000100:00100000:2.0:1788592785.336504:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 223 00000100:00100000:2.0:1788592785.336513:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209154944:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592785.336558:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209154944:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 46us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592785.336577:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 223 00010000:00010000:2.0:1788592785.336838:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788592785.730500:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:2.0:1788592785.730510:0:9505:0:(genops.c:885:class_export_put()) final put ffff9218767b4800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:1.0:1788592785.730606:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9218767b4800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-OST0001 00000020:00000080:1.0:1788592785.730656:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217439bd000 for lustre-OST0001 00000100:00100000:0.0:1788592786.232647:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226018048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592786.232741:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592786.232858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018048 00000100:00100000:2.0:1788592786.232868:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018048 00000100:00100000:2.0:1788592786.232933:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788592786.232942:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226018048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592786.232981:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592786.233122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226018048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592786.233130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788592786.233218:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226018048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592786.233354:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592786.233560:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226018176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592786.233651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592786.233796:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018176 00000100:00100000:0.0:1788592786.233802:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018176 00000100:00100000:0.0:1788592786.233885:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788592786.233893:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226018176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592786.233915:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592786.233972:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226018176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592786.233979:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788592786.234055:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226018176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592786.360290:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592787.384380:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592788.281688:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226018304:0@lo:400:kworker.0 00000100:00100000:1.0:1788592788.281763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.281793:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592788.281826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226018688:0@lo:400:kworker.0 00000100:00100000:1.0:1788592788.281833:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226018816:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.281841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592788.282834:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592788.282867:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226019200:0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.282900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592788.282918:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226019712:0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.282939:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592788.282980:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018432 00000100:00100000:2.0:1788592788.282987:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018432 00000100:00100000:2.0:1788592788.283039:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788592788.283049:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226018432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592788.283096:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592788.283136:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226018432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592788.283152:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788592788.283177:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018688 00000100:00100000:2.0:1788592788.283181:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018688 00000100:00100000:2.0:1788592788.283207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788592788.283213:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226018688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.283254:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226018688:12345-0@lo:400:kworker.0 Request processed in 41us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592788.283260:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788592788.283277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019200 00000100:00100000:2.0:1788592788.283281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019200 00000100:00100000:2.0:1788592788.283306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019712 00000100:00100000:2.0:1788592788.283309:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019712 00000100:00100000:2.0:1788592788.283328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788592788.283334:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226019200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.283364:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226019200:12345-0@lo:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592788.283370:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788592788.283382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788592788.283388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226019712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.283413:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226019712:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592788.283419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1788592788.283434:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592788.283438:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592788.283475:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226018688:0@lo:400:kworker.0 00010000:00080000:2.0:1788592788.283489:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f0a80 x1875475226019200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592788.283506:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226019200:0@lo:400:kworker.0 00010000:00080000:2.0:1788592788.283518:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f2a00 x1875475226019712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592788.283526:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226019712:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.284435:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592788.284447:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226018944:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.284484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.284517:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226019456:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.284541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.284567:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226019968:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.284588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.284610:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788592788.284617:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226018560:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.284635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.284671:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226019072:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.284692:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.284708:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226019584:0@lo:400:kworker.0 00000100:00100000:3.0:1788592788.284718:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018944 00000100:00100000:3.0:1788592788.284725:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018944 00000100:00100000:0.0:1788592788.284732:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592788.284758:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018560 00000100:00100000:3.0:1788592788.284762:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018560 00000100:00100000:3.0:1788592788.284790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019072 00000100:00100000:3.0:1788592788.284793:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019072 00000100:00100000:3.0:1788592788.284815:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019584 00000100:00100000:3.0:1788592788.284818:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019584 00000100:00100000:3.0:1788592788.284835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788592788.284843:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226018944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592788.284891:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226018944:12345-0@lo:400:kworker.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592788.284898:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788592788.284914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788592788.284920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226018560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592788.284947:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226018560:12345-0@lo:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592788.284961:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788592788.284975:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788592788.284981:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226019072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592788.285013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226019072:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592788.285019:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788592788.285029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788592788.285035:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226019584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592788.285063:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226019584:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592788.285118:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019456 00000100:00100000:0.0:1788592788.285122:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019456 00000100:00100000:0.0:1788592788.285147:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019968 00000100:00100000:0.0:1788592788.285149:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019968 00000100:00100000:0.0:1788592788.285165:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788592788.285172:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226019456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.285204:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226019456:12345-0@lo:400:kworker.0 Request processed in 32us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592788.285212:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788592788.285228:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788592788.285233:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788592788.285238:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226019968:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788592788.285258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592788.285264:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592788.285274:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226019968:12345-0@lo:400:kworker.0 Request processed in 38us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592788.285280:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788592788.285336:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226018560:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.285347:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226019072:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.285368:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226019584:0@lo:400:kworker.0 00010000:00080000:0.0:1788592788.285379:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f3480 x1875475226019456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592788.285389:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226019456:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.285397:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226019968:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.285407:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226018944:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.285450:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018304 00000100:00100000:0.0:1788592788.285453:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018304 00000100:00100000:2.0:1788592788.286204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788592788.286218:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226018304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.286266:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226018304:12345-0@lo:400:kworker.0 Request processed in 52us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592788.286271:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788592788.288698:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592788.288756:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226019328:0@lo:400:kworker.0 00000100:00100000:1.0:1788592788.288926:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592788.288969:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019328 00000100:00100000:1.0:1788592788.288977:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019328 00000100:00100000:1.0:1788592788.289036:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788592788.289046:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226019328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.289047:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226018816 00000100:00100000:2.0:1788592788.289055:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226018816 00000100:00100000:2.0:1788592788.289115:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788592788.289123:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226018816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592788.289179:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226018816:12345-0@lo:400:kworker.0 Request processed in 58us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592788.289186:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788592788.289220:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592788.289236:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226019840:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.289267:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592788.289308:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226018304:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.289340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226018816:0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.289367:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226019840 00000100:00100000:0.0:1788592788.289371:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226019840 00000100:00100000:0.0:1788592788.289404:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788592788.289411:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226019840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592788.289446:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226019840:12345-0@lo:400:kworker.0 Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592788.289452:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788592788.289470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592788.289486:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226019840:0@lo:400:kworker.0 00000100:00100000:1.0:1788592788.290219:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226019328:12345-0@lo:400:kworker.0 Request processed in 1171us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592788.290231:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788592788.290267:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f3b80 x1875475226019328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592788.290278:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226019328:0@lo:400:kworker.0 00010000:00010000:2.0:1788592788.415924:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592788.792690:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226020096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592788.792766:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592788.792873:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020096 00000100:00100000:3.0:1788592788.792881:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020096 00000100:00100000:3.0:1788592788.794013:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788592788.794029:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226020096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592788.794055:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592788.794520:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226020096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 494us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592788.794529:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788592788.794721:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226020096:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788592788.985445:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788592788.989457:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788592789.304301:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226020224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592789.304373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592789.304416:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592789.304423:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226020352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592789.304452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592789.304493:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020224 00000100:00100000:2.0:1788592789.304513:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020224 00000100:00100000:0.0:1788592789.304543:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020352 00000100:00100000:0.0:1788592789.304550:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020352 00000100:00100000:2.0:1788592789.304568:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788592789.304578:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226020224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592789.304606:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592789.304664:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226020224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592789.304671:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1788592789.304712:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b53800 x1875475226020224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592789.304731:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226020224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592789.305530:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788592789.305544:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226020352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592789.305561:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592789.305780:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226020352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 241us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592789.305788:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1788592789.306008:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218698b4380 x1875475226020352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592789.306036:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226020352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788592789.432180:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.458441:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592790.464491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592790.464534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592790.464559:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592790.464579:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592790.464613:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592790.464661:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155584 00000100:00100000:3.0:1788592790.464670:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155584 00000100:00100000:3.0:1788592790.464731:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155840 00000100:00100000:3.0:1788592790.464735:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155840 00000100:00100000:3.0:1788592790.464750:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155456 00000100:00100000:3.0:1788592790.464752:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155456 00000100:00100000:3.0:1788592790.464763:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155712 00000100:00100000:3.0:1788592790.464766:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155712 00000100:00100000:3.0:1788592790.464784:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 230 00000100:00100000:3.0:1788592790.464795:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209155584:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592790.464869:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209155584:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.464877:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 230 00000100:00100000:3.0:1788592790.464895:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 231 00000100:00100000:3.0:1788592790.464902:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209155840:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592790.464927:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209155840:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.464933:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 231 00000100:00100000:3.0:1788592790.464946:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 232 00000100:00100000:3.0:1788592790.464953:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209155456:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592790.464977:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209155456:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.464984:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 232 00000100:00100000:3.0:1788592790.464995:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 233 00000100:00100000:3.0:1788592790.465001:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209155712:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592790.465025:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209155712:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.465038:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 233 00000100:00080000:3.0:1788592790.465094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592790.465098:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592790.465431:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155328 00000100:00100000:0.0:1788592790.465436:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155328 00000100:00100000:0.0:1788592790.465481:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 369 00000100:00100000:0.0:1788592790.465489:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2393:x1875475209155328:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592790.465514:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2393:x1875475209155328:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592790.465520:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 369 00000001:02000400:1.0:1788592790.530334:0:14048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:19:49 (1788592789) 00000100:00100000:0.0:1788592791.352332:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226020480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592791.352405:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592791.352474:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592791.352481:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226020608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592791.352507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592791.352546:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020480 00000100:00100000:0.0:1788592791.352554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020480 00000100:00100000:0.0:1788592791.352599:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020608 00000100:00100000:0.0:1788592791.352602:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020608 00000100:00100000:0.0:1788592791.352617:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788592791.352645:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226020480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592791.352703:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788592791.352751:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226020480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592791.352759:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788592791.352776:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788592791.352783:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226020608:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592791.353046:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226020480:0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592791.353926:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788592791.354053:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226020608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1269us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592791.354063:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788592791.354291:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226020608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788592791.480201:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592791.616763:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592791.616892:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209155968 00000100:00100000:0.0:1788592791.616912:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209155968 00000100:00100000:0.0:1788592791.616985:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:0.0:1788592791.616997:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:11069:x1875475209155968:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592791.617019:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592791.617128:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d89 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.617207:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db4ffb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.617221:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db4ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.617236:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db4ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592791.617285:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592791.617301:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592791.617343:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db4ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.617374:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db4ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d89 expref: 7 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.617392:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db4ffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d89 expref: 6 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.617400:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0b00) 00010000:00010000:0.0:1788592791.617403:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592791.617407:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1a00, rc 0) 00000100:00100000:0.0:1788592791.617468:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:11069:x1875475209155968:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 473us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592791.617475:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:3.0:1788592791.626804:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592791.626944:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209156096 00000100:00100000:0.0:1788592791.626955:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209156096 00000100:00100000:0.0:1788592791.627012:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:0.0:1788592791.627023:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:11070:x1875475209156096:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592791.627043:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592791.627113:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d90 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627361:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627376:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627404:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627420:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627427:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627434:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627494:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db5017 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627503:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db5017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627510:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db5017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592791.627549:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592791.627552:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592791.627568:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db5017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627578:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627585:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627601:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627607:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592791.627611:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627618:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627643:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0b00) 00010000:00010000:0.0:1788592791.627646:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592791.627650:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627656:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627669:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627675:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627682:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627687:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592791.627690:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627706:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627715:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff921875ae0e00) 00010000:00010000:0.0:1788592791.627717:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592791.627720:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627726:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5010 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627767:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d90 expref: 8 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627780:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db5017 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d90 expref: 7 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592791.627786:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:0.0:1788592791.627788:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592791.627790:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0c00, rc 0) 00000100:00100000:0.0:1788592791.630032:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11070:x1875475209156096:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592791.630045:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:3.0:1788592791.635172:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592791.635825:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209156224 00000100:00100000:1.0:1788592791.635835:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209156224 00000100:00100000:0.0:1788592791.635948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:0.0:1788592791.635961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11070:x1875475209156224:12345-192.168.203.47@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788592791.636393:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11070:x1875475209156224:12345-192.168.203.47@tcp:900:lhsmtool_posix.0 Request processed in 434us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592791.636412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:1.0:1788592791.647406:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592791.647573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209156480 00000100:00100000:3.0:1788592791.647583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209156480 00000100:00100000:3.0:1788592791.647655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:3.0:1788592791.647666:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11070:x1875475209156480:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592791.647686:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592791.647707:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db501e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d97 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.647918:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.647933:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.648010:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649410:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649425:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649435:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649649:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db5033 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649673:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db5033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649680:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db5033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592791.649710:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788592791.649799:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649807:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649813:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649819:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592791.649824:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649831:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649843:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:3.0:1788592791.649846:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592791.649851:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649868:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649883:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649889:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649894:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649900:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592791.649903:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649908:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649915:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff921882176100) 00010000:00010000:3.0:1788592791.649917:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592791.649920:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.649926:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db502c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.650257:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db501e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d97 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.650272:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db5033 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d97 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592791.650286:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:3.0:1788592791.650288:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592791.650291:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f800, rc 0) 00000100:00100000:3.0:1788592791.651891:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11070:x1875475209156480:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 4218us (4703us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788592791.651903:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:3.0:1788592791.660132:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592791.660406:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209156608 00000100:00100000:0.0:1788592791.660422:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209156608 00000100:00100000:0.0:1788592791.660493:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:0.0:1788592791.660504:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11070:x1875475209156608:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788592791.660666:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11070:x1875475209156608:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 Request processed in 164us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592791.660673:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:2.0:1788592791.668158:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592791.668389:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209156736 00000100:00100000:0.0:1788592791.668400:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209156736 00000100:00100000:0.0:1788592791.668458:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:0.0:1788592791.668468:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:11070:x1875475209156736:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788592791.671975:0:13208:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3469us 00000100:00100000:3.0:1788592791.692432:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:11070:x1875475209156736:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 Request processed in 23955us (24273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592791.692445:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000040:00080000:3.0:1788592792.058451:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788592792.060414:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788592792.504775:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592793.243057:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.243159:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209156864 00000100:00100000:3.0:1788592793.243169:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209156864 00000100:00100000:3.0:1788592793.243242:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:3.0:1788592793.243252:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11112:x1875475209156864:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592793.243271:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592793.243291:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2d9e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243368:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243382:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243406:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243414:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243422:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243468:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243476:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243482:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243488:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592793.243492:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243500:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243512:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0b00) 00010000:00010000:3.0:1788592793.243515:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592793.243520:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243526:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243546:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243552:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243557:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243562:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592793.243565:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243572:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243581:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff921882176100) 00010000:00010000:3.0:1788592793.243584:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592793.243587:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243593:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db504f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243634:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5041 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d9e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243645:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0b00) 00010000:00010000:3.0:1788592793.243647:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592793.243658:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d9e expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.243668:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205fa00, rc 0) 00000100:00100000:3.0:1788592793.243732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11112:x1875475209156864:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 481us (686us total) trans 0 rc 301/301 00000100:00100000:3.0:1788592793.243739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00080000:1.0:1788592793.243945:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592793.252530:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.252669:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209157120 00000100:00100000:2.0:1788592793.252680:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209157120 00000100:00100000:2.0:1788592793.252726:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:2.0:1788592793.252737:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11112:x1875475209157120:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1788592793.252794:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592793.252821:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db4ffb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d89 expref: 9 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.252838:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0b00) 00010000:00010000:2.0:1788592793.252848:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592793.252912:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.252939:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.252950:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.252963:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.252971:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.252978:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253699:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253712:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253721:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592793.253736:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000116fcf07 reply state 000000002a166cb2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253747:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253754:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592793.253765:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592793.253769:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788592793.253774:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788592793.253782:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253790:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253796:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253802:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592793.253807:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253815:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253824:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921743723100) 00010000:00010000:2.0:1788592793.253826:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592793.253830:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253836:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5056 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592793.253852:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000116fcf07 reply state 000000002a166cb2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253860:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.253877:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff921743723e00) 00010000:00010000:2.0:1788592793.253880:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592793.253882:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788592793.253984:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:11112:x1875475209157120:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 1246us (1460us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788592793.253992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:3.0:1788592793.331309:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.331505:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209157248 00000100:00100000:0.0:1788592793.331515:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209157248 00000100:00100000:0.0:1788592793.331588:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:0.0:1788592793.331598:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:11120:x1875475209157248:12345-192.168.203.47@tcp:101:lctl.0 00010000:00010000:0.0:1788592793.331631:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.331654:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db506b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2da5 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.331721:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5072 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.331735:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.331761:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592793.331811:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592793.331820:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592793.331857:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5072 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.331880:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db506b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2da5 expref: 12 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.331896:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5072 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2da5 expref: 11 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.331904:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:0.0:1788592793.331907:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592793.331910:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1c00, rc 0) 00000100:00100000:0.0:1788592793.332365:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:11120:x1875475209157248:12345-192.168.203.47@tcp:101:lctl.0 Request processed in 766us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.332373:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:1.0:1788592793.395768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.395850:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209157376 00000100:00100000:3.0:1788592793.395870:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209157376 00000100:00100000:3.0:1788592793.395936:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:3.0:1788592793.395947:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:11126:x1875475209157376:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592793.395966:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592793.395987:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2dac expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396063:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396330:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396343:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396357:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396366:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396386:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396467:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f200/0xbd314a3362db508e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396476:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f200/0xbd314a3362db508e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396485:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f200/0xbd314a3362db508e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592793.396532:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788592793.396536:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592793.396570:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f200/0xbd314a3362db508e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396582:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396589:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396595:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396601:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592793.396605:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396623:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396643:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:3.0:1788592793.396645:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592793.396650:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396656:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396669:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396674:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396680:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396685:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592793.396687:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396693:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396700:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff921743723e00) 00010000:00010000:3.0:1788592793.396702:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592793.396705:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396710:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396748:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dac expref: 13 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396763:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f200/0xbd314a3362db508e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dac expref: 12 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.396770:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592793.396772:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788592793.396775:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f200, rc 0) 00000100:00100000:3.0:1788592793.396904:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:11126:x1875475209157376:12345-192.168.203.47@tcp:101:bash.0 Request processed in 957us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.396912:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:1.0:1788592793.400429:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226020736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592793.400498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592793.400559:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020736 00000100:00100000:3.0:1788592793.400567:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020736 00000100:00080000:1.0:1788592793.400601:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592793.400627:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592793.400635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788592793.400635:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226020864:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.400646:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226020736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592793.400673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788592793.400677:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592793.400702:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226021248:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.400724:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226020736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.400732:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788592793.400764:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226021376:0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.400767:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226021120:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.400804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592793.400807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592793.400820:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020864 00000100:00100000:3.0:1788592793.400825:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226021888:0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.400838:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020864 00000100:00100000:3.0:1788592793.400854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592793.400854:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226020736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592793.400879:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788592793.400887:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226020864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.400891:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788592793.400907:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226021760:0@lo:400:kworker.0 00000100:00100000:1.0:1788592793.400991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226020864:0@lo:400:kworker.0 00000100:00100000:1.0:1788592793.401282:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226020992:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.401658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592793.401680:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226022272:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.401704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592793.401735:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021888 00000100:00100000:3.0:1788592793.401739:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021888 00000100:00100000:3.0:1788592793.401774:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021760 00000100:00100000:3.0:1788592793.401777:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021760 00000100:00100000:3.0:1788592793.401794:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226022272 00000100:00100000:3.0:1788592793.401797:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226022272 00000100:00100000:3.0:1788592793.401812:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788592793.401818:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.401857:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226021888:12345-0@lo:400:kworker.0 Request processed in 39us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.401949:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788592793.401965:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592793.401971:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226021760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.401981:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226020864:12345-0@lo:400:kworker.0 Request processed in 1092us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.402002:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788592793.402005:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226021760:12345-0@lo:400:kworker.0 Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.402012:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592793.402028:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788592793.402035:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226022272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.402060:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226022272:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.402086:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788592793.402096:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021248 00000100:00100000:0.0:1788592793.402102:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021248 00000100:00100000:0.0:1788592793.402130:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788592793.402137:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226021248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.402181:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226021248:12345-0@lo:400:kworker.0 Request processed in 44us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.402189:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1788592793.402200:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921844d4d500 x1875475226021760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592793.402212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592793.402228:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226021760:0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.402236:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226021632:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.402246:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226022272:0@lo:400:kworker.0 00010000:00080000:3.0:1788592793.402261:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921844d4c700 x1875475226021888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592793.402271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592793.402272:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226021888:0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.402296:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226022144:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.402306:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021120 00000100:00100000:3.0:1788592793.402311:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021120 00000100:00100000:0.0:1788592793.402321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592793.402342:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788592793.402350:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226021120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.402361:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021376 00000100:00100000:0.0:1788592793.402367:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021376 00000100:00100000:0.0:1788592793.402392:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021632 00000100:00100000:0.0:1788592793.402394:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021632 00000100:00100000:0.0:1788592793.402412:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226022144 00000100:00100000:0.0:1788592793.402414:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226022144 00000100:00100000:0.0:1788592793.402428:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788592793.402434:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226021376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.402804:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226021120:12345-0@lo:400:kworker.0 Request processed in 455us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.402812:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788592793.402837:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788592793.402845:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226021632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.402869:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226021376:12345-0@lo:400:kworker.0 Request processed in 433us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.402876:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788592793.402890:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788592793.402897:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226022144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592793.402974:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.403002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209157632 00000100:00100000:2.0:1788592793.403007:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209157632 00000100:00100000:0.0:1788592793.403011:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226022144:12345-0@lo:400:kworker.0 Request processed in 113us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.403019:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788592793.403039:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:0.0:1788592793.403209:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226021120:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.403211:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226021632:12345-0@lo:400:kworker.0 Request processed in 366us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.403222:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:0.0:1788592793.403229:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921876654e00 x1875475226021632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592793.403242:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226021632:0@lo:400:kworker.0 00010000:00080000:0.0:1788592793.403258:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921844d4dc00 x1875475226022144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592793.403260:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226021376:0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.403275:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226022144:0@lo:400:kworker.0 00000100:00080000:0.0:1788592793.403331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592793.403337:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226021248:0@lo:400:kworker.0 00000100:00080000:0.0:1788592793.403337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592793.403342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592793.403402:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:11126:x1875475209157632:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592793.403415:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592793.403513:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5095 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2db3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.403629:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.403645:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.403658:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.403726:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.403735:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.403755:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592793.404311:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788592793.404537:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404549:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404557:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404588:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404594:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404602:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404619:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592793.404624:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404632:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404644:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592793.404647:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592793.404663:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404670:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db509c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592793.404684:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff87ad78 reply state 0000000017df77c6 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404694:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404700:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:2.0:1788592793.404702:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592793.404704:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788592793.404736:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5095 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404749:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.404756:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:2.0:1788592793.404759:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592793.404761:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb000, rc 0) 00000100:00100000:2.0:1788592793.404830:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:11126:x1875475209157632:12345-192.168.203.47@tcp:101:bash.0 Request processed in 1783us (1857us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788592793.404837:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:1.0:1788592793.404895:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592793.404935:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226021504:0@lo:400:kworker.0 00000100:00100000:1.0:1788592793.404964:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592793.404982:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226022016:0@lo:400:kworker.0 00000100:00100000:1.0:1788592793.405002:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592793.410132:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226020992 00000100:00100000:0.0:1788592793.410145:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226020992 00000100:00100000:0.0:1788592793.410201:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226021504 00000100:00100000:0.0:1788592793.410204:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226021504 00000100:00100000:0.0:1788592793.410236:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226022016 00000100:00100000:0.0:1788592793.410240:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226022016 00000100:00100000:0.0:1788592793.410264:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788592793.410274:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226020992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.410286:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788592793.410299:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226021504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.410358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226021504:12345-0@lo:400:kworker.0 Request processed in 63us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.410377:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788592793.410397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788592793.410403:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226022016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592793.410449:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226020992:12345-0@lo:400:kworker.0 Request processed in 177us (5553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.410457:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:0.0:1788592793.410476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592793.410514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226022016:12345-0@lo:400:kworker.0 Request processed in 110us (5510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.410522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788592793.410548:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.410603:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209157760 00000100:00100000:3.0:1788592793.410617:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209157760 00000100:00100000:3.0:1788592793.410650:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:3.0:1788592793.410655:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875475209157760:12345-192.168.203.47@tcp:8:bash.0 00010000:00080000:3.0:1788592793.410680:0:10091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:3.0:1788592793.410711:0:10091:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db50b8 00002000:00100000:3.0:1788592793.410724:0:10091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7fa053f8-dea8-45a9-81cb-9946b4fa9e00/ffff92184ac59000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592793.410740:0:10091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788592793.410997:0:10091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788592793.411026:0:10091:0:(import.c:65:import_set_state_nolock()) ffff92184ac5a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592793.411157:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209157760:12345-192.168.203.47@tcp:8:bash.0 Request processed in 433us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.411167:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:1.0:1788592793.415866:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226020992:0@lo:400:kworker.0 00000100:00100000:1.0:1788592793.415887:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226021504:0@lo:400:kworker.0 00000100:00100000:1.0:1788592793.415899:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226022016:0@lo:400:kworker.0 00000100:00100000:3.0:1788592793.416540:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.416800:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209157888 00000100:00100000:0.0:1788592793.416809:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209157888 00000100:00100000:0.0:1788592793.416889:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1788592793.416900:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:0:x1875475209157888:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592793.416927:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.416957:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2dba expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592793.416985:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592793.417004:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:0.0:1788592793.417008:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592793.417018:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.417039:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.417054:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1600, rc 0) 00000100:00100000:0.0:1788592793.417139:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:0:x1875475209157888:12345-192.168.203.47@tcp:101:bash.0 Request processed in 240us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.417146:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00080000:2.0:1788592793.417412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592793.422912:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.423013:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209158016 00000100:00100000:0.0:1788592793.423026:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209158016 00000100:00100000:0.0:1788592793.423128:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:0.0:1788592793.423139:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11126:x1875475209158016:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592793.423156:0:8590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.423197:0:8590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2dc1 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.423230:0:8590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.423240:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592793.423243:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592793.423249:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.423280:0:8590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.423293:0:8590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592793.423305:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226022400:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592793.423571:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592793.426400:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226022400:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592793.426438:0:8590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.426459:0:8590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0200, rc 0) 00000100:00100000:0.0:1788592793.426555:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:11126:x1875475209158016:12345-192.168.203.47@tcp:101:bash.0 Request processed in 3417us (3651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.426581:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:1.0:1788592793.427656:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.427938:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209158144 00000100:00100000:2.0:1788592793.427948:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209158144 00010000:00010000:2.0:1788592793.427984:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592793.428105:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:2.0:1788592793.428114:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209158144:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592793.428129:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592793.428150:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.428164:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.428206:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061ec61cd/0xbd314a3362db50bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dba expref: 8 pid: 8427 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.428222:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592793.428226:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592793.428234:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 7 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.428243:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 7 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.428278:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 7 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592793.428292:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218767bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10331:1875475226022528:192.168.203.47@tcp:105: 00000100:00100000:2.0:1788592793.428365:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184f8f8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788592793.432119:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218767bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10331:1875475226022528:192.168.203.47@tcp:105: 00010000:00010000:2.0:1788592793.432146:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592793.432212:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209158144:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 4097us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592793.432224:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:1.0:1788592793.434331:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.434448:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209158400 00000100:00100000:0.0:1788592793.434457:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209158400 00000100:00100000:0.0:1788592793.434543:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:0.0:1788592793.434555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:11126:x1875475209158400:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:0.0:1788592793.434863:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11126:x1875475209158400:12345-192.168.203.47@tcp:35:bash.0 Request processed in 309us (538us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788592793.434871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:3.0:1788592793.505134:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592793.505548:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209158656 00000100:00100000:1.0:1788592793.505559:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209158656 00000100:00100000:1.0:1788592793.505628:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:1.0:1788592793.505638:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11136:x1875475209158656:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1788592793.505664:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592793.505687:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db50cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2dc8 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592793.505803:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788592793.505916:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db50cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc8 expref: 18 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.505932:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:1.0:1788592793.505935:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592793.505954:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db50cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc8 expref: 18 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.505968:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839400, rc 0) 00000100:00100000:1.0:1788592793.506044:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:11136:x1875475209158656:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 408us (919us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1788592793.506052:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:1.0:1788592793.509302:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.509550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209158912 00000100:00100000:2.0:1788592793.509560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209158912 00000100:00100000:2.0:1788592793.509668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:2.0:1788592793.509680:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:11136:x1875475209158912:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592793.509919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:11136:x1875475209158912:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 241us (625us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788592793.509927:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00010000:00010000:1.0:1788592793.528340:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592793.565528:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.565649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209159040 00000100:00100000:0.0:1788592793.565658:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209159040 00000100:00100000:0.0:1788592793.565752:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:0.0:1788592793.565764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218767bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:11142:x1875475209159040:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592793.565787:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.565807:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db50db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2dcf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.565874:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db50e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.565888:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db50e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.565899:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db50e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592793.565955:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788592793.565959:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592793.565997:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db50e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.566023:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db50db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dcf expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.566040:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db50e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dcf expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.566049:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592793.566052:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592793.566056:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0e00, rc 0) 00000100:00100000:0.0:1788592793.566172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218767bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:11142:x1875475209159040:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 410us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.566180:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:2.0:1788592793.569538:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.569633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209159296 00000100:00100000:3.0:1788592793.569643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209159296 00000100:00100000:3.0:1788592793.569736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:3.0:1788592793.569760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:11142:x1875475209159296:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592793.569780:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592793.569800:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db50e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2dd6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.569923:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db50f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.569938:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db50f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.569951:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db50f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592793.569962:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788592793.570114:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db50e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dd6 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.570134:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db50f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dd6 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.570142:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:3.0:1788592793.570145:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592793.570148:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ee00, rc 0) 00000100:00100000:3.0:1788592793.570213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:11142:x1875475209159296:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 454us (682us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788592793.570221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:1.0:1788592793.573846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592793.573888:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.573955:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209159424 00000100:00100000:3.0:1788592793.573964:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209159424 00000100:00100000:3.0:1788592793.574046:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:3.0:1788592793.574057:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:2394:x1875475209159424:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592793.574102:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592793.574130:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db50f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dd6 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.574148:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:3.0:1788592793.574153:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592793.574214:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:2394:x1875475209159424:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.574222:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:0.0:1788592793.575229:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209159680 00000100:00100000:0.0:1788592793.575236:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209159680 00000100:00100000:0.0:1788592793.575309:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:0.0:1788592793.575317:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11142:x1875475209159680:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592793.575339:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.575354:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db50fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ddd expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.575450:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5105 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.575465:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.575476:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592793.575498:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788592793.575597:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db50fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ddd expref: 23 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.575623:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5105 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ddd expref: 22 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.575631:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:0.0:1788592793.575634:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788592793.575637:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1600, rc 0) 00000100:00100000:0.0:1788592793.575683:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11142:x1875475209159680:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 367us (1794us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788592793.575690:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:1.0:1788592793.581362:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.584119:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209159808 00000100:00100000:0.0:1788592793.584134:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209159808 00000100:00100000:0.0:1788592793.584207:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:0.0:1788592793.584219:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209159808:12345-192.168.203.47@tcp:1:lfs.0 00010000:00010000:0.0:1788592793.584265:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.584289:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 7 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.584299:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592793.584304:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592793.584309:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.585271:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 7 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.585297:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 7 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592793.585313:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875475226022656:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592793.585413:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592793.590026:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.590112:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875475226022656:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592793.590140:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592793.590406:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209159936 00000100:00100000:3.0:1788592793.590414:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209159936 00002000:00100000:3.0:1788592793.590454:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff92186f50b480 x1875475209159936/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:69/0 lens 504/0 e 0 to 0 dl 1788592804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592793.590464:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92186f50b480 with x1875475209159936 ext(0->12) 00010000:00010000:3.0:1788592793.590472:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 8 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.590491:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 8 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592793.590499:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92186f50b480 00000100:00100000:3.0:1788592793.590530:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:3.0:1788592793.590539:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209159936:12345-192.168.203.47@tcp:4:lfs.0 00000001:00100000:0.0:1788592793.592809:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000100:00100000:3.0:1788592793.593588:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2395:x1875475209159936:12345-192.168.203.47@tcp:4:lfs.0 Request processed in 3043us (3562us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788592793.593619:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00002000:00100000:3.0:1788592793.593631:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff92186f50b480 x1875475209159936/t4294967300(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:69/0 lens 504/448 e 0 to 0 dl 1788592804 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592793.593642:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92186f50b480 with x1875475209159936 ext(0->12) 00010000:00010000:3.0:1788592793.593651:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 9 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.593667:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 9 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592793.593674:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92186f50b480 00000100:00100000:2.0:1788592793.596142:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.596429:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209160064 00000100:00100000:0.0:1788592793.596437:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209160064 00010000:00010000:0.0:1788592793.596477:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 9 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592793.596517:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:0.0:1788592793.596526:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2393:x1875475209160064:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592793.596541:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788592793.596558:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788592793.596561:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788592793 00002000:00010000:0.0:1788592793.596563:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788592793 00002000:00010000:0.0:1788592793.596573:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788592793 00002000:00010000:0.0:1788592793.596575:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788592793.596583:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 9 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.596597:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 9 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.596628:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c599c658/0xbd314a3362db50c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dc1 expref: 9 pid: 8590 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.596644:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592793.596649:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592793.596654:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.596662:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.596694:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592793.596751:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2393:x1875475209160064:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 225us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.596758:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00010000:00010000:3.0:1788592793.596861:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596870:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596889:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596898:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596905:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596923:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592793.596928:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596938:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596954:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.596962:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000126192b/0xbd314a3362db5113 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592793.597007:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209159808:12345-192.168.203.47@tcp:1:lfs.0 Request processed in 12792us (15656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592793.597016:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:1.0:1788592793.599318:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.599372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209160320 00000100:00100000:0.0:1788592793.599382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209160320 00000100:00100000:0.0:1788592793.599443:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:0.0:1788592793.599454:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11142:x1875475209160320:12345-192.168.203.47@tcp:35:lfs.0 00000004:00010000:0.0:1788592793.599524:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5105 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ddd expref: 22 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592793.600766:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788592793.600809:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788592793.601559:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788592793.601605:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.601634:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.601644:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.601679:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.601694:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 26 pid: 6512 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592793.601709:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1875475226022784:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592793.601800:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592793.603804:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1875475226022784:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592793.603827:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592793.604460:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.604632:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209160448 00000100:00100000:3.0:1788592793.604639:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209160448 00010000:00010000:3.0:1788592793.604674:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 27 pid: 6512 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592793.604715:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:3.0:1788592793.604724:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:2395:x1875475209160448:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592793.604739:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592793.604745:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 27 pid: 6512 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.604772:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 27 pid: 6512 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.604794:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db50aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2db3 expref: 27 pid: 6512 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.604811:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:3.0:1788592793.604816:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.604824:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.604831:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.604855:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592793.604909:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592793.604924:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+26:2395:x1875475209160448:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 198us (463us total) trans 0 rc 0/0 00010000:00010000:0.0:1788592793.604929:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592793.604935:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000001:00080000:1.0:1788592793.605478:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788592793.605600:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788592793.605698:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226022912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788592793.605738:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592793.605764:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592793.606004:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226022912 00000100:00100000:0.0:1788592793.606010:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226022912 00000100:00100000:0.0:1788592793.606218:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788592793.606230:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875475226022912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788592793.606310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875475226022912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.606318:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788592793.606406:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226022912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788592793.606549:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788592793.606597:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226023040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788592793.606635:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592793.606903:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858756840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592793.606938:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226023040 00000100:00100000:3.0:1788592793.606944:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226023040 00000100:00100000:0.0:1788592793.607003:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788592793.607011:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875475226023040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788592793.607144:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1875475226023040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (508us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788592793.607151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788592793.607222:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743a91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226023040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788592793.607265:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788592793.607299:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.607322:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.607329:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.607334:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592793.607339:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.607347:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.607361:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:1.0:1788592793.607364:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788592793.607370:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.607381:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db511a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592793.607477:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788592793.607539:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788592793.607559:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327854491463ns, next at 328854479295ns, rc = 0 00000001:00080000:1.0:1788592793.607566:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788592793.607587:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921743723800) 00010000:00010000:1.0:1788592793.607590:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788592793.607597:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5105 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ddd expref: 30 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592793.607708:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:11142:x1875475209160320:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 8256us (8398us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788592793.607718:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00000020:00080000:1.0:1788592793.607721:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788592793.609615:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.609679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209160576 00000100:00100000:0.0:1788592793.609689:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209160576 00000100:00100000:0.0:1788592793.609808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:0.0:1788592793.609820:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:11142:x1875475209160576:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592793.609842:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.609864:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5121 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2de4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.609963:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5121 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2de4 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.610007:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5121 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2de4 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.610027:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592793.610030:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592793.610034:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0200, rc 0) 00000100:00100000:0.0:1788592793.610124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11142:x1875475209160576:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 307us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.610131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:1.0:1788592793.613519:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.613604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209160832 00000100:00100000:2.0:1788592793.613623:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209160832 00000100:00100000:2.0:1788592793.613678:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:2.0:1788592793.613688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186969b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11142:x1875475209160832:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592793.613919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186969b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+31:11142:x1875475209160832:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 232us (409us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788592793.613928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:1.0:1788592793.684848:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.685057:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209161088 00000100:00100000:3.0:1788592793.685105:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209161088 00000100:00100000:3.0:1788592793.685173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:3.0:1788592793.685184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+31:11152:x1875475209161088:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592793.685207:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592793.685228:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2deb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592793.685339:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788592793.686271:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5128 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2deb expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.686290:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:3.0:1788592793.686293:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592793.686299:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2deb expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.686314:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ee00, rc 0) 00000100:00100000:3.0:1788592793.686456:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11152:x1875475209161088:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1272us (1616us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788592793.686464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:3.0:1788592793.691946:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.692419:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209161216 00000100:00100000:0.0:1788592793.692429:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209161216 00000100:00100000:0.0:1788592793.692491:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:0.0:1788592793.692501:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11152:x1875475209161216:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:0.0:1788592793.692571:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692588:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692602:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692626:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692633:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692651:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692731:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692739:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692747:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592793.692793:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692807:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692813:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692820:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692825:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592793.692829:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692837:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692847:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592793.692856:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592793.692861:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692867:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5136 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692879:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692885:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692891:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692896:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592793.692899:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692904:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692911:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:0.0:1788592793.692914:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592793.692917:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692923:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db513d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692932:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692944:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692949:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692954:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592793.692957:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692963:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692970:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592793.692972:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592793.692975:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.692980:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592793.693062:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11152:x1875475209161216:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 561us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.693114:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:1.0:1788592793.695745:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.695846:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209161472 00000100:00100000:2.0:1788592793.695870:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209161472 00000100:00100000:2.0:1788592793.695921:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:2.0:1788592793.695932:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11152:x1875475209161472:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592793.696170:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:11152:x1875475209161472:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 239us (437us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788592793.696178:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:2.0:1788592793.727499:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592793.728114:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209161728 00000100:00100000:0.0:1788592793.728125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209161728 00000100:00100000:0.0:1788592793.728249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:0.0:1788592793.728260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:11155:x1875475209161728:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592793.728291:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592793.728325:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db514b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2df2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728414:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728430:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728441:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728452:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728459:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728466:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728597:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728617:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728625:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592793.728634:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788592793.728709:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728726:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728733:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728739:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592793.728743:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728751:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728764:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592793.728767:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592793.728771:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728778:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db5152 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728793:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728799:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728805:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728811:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592793.728820:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728826:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728835:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:0.0:1788592793.728837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592793.728840:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728846:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728894:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db514b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728909:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.728916:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592793.728918:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592793.728921:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0800, rc 0) 00000100:00100000:0.0:1788592793.729059:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11155:x1875475209161728:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 799us (1567us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788592793.729106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:3.0:1788592793.732854:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.732985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209161856 00000100:00100000:2.0:1788592793.732994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209161856 00000100:00100000:2.0:1788592793.733052:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:2.0:1788592793.733062:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11155:x1875475209161856:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:2.0:1788592793.733262:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733496:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733510:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733546:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733552:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733558:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733563:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592793.733580:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733588:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733599:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592793.733602:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592793.733615:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.733622:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db516e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592793.733693:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11155:x1875475209161856:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 632us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592793.733701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:1.0:1788592793.737056:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.737432:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209162112 00000100:00100000:2.0:1788592793.737442:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209162112 00000100:00100000:1.0:1788592793.737541:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:1.0:1788592793.737553:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11155:x1875475209162112:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:1.0:1788592793.737874:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+36:11155:x1875475209162112:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 324us (825us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788592793.737882:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:0.0:1788592793.913369:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226023168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592793.913443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592793.913584:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226023168 00000100:00100000:2.0:1788592793.913592:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226023168 00000100:00100000:2.0:1788592793.913658:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788592793.913667:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226023168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592793.913690:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592793.913779:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226023168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592793.913786:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788592793.913984:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226023168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592793.961509:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.961588:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209162368 00000100:00100000:3.0:1788592793.961598:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209162368 00000100:00100000:3.0:1788592793.961670:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:3.0:1788592793.961680:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+36:11186:x1875475209162368:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:3.0:1788592793.961704:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592793.961735:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2df9 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.961839:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db517c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.961880:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db517c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.961894:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db517c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592793.961907:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788592793.963401:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df9 expref: 39 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.963426:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db517c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df9 expref: 38 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592793.963434:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592793.963437:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592793.963441:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205fa00, rc 0) 00000100:00100000:3.0:1788592793.963589:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11186:x1875475209162368:12345-192.168.203.47@tcp:101:cat.0 Request processed in 1909us (2088us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788592793.963598:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:3.0:1788592793.968635:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592793.968689:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592793.968925:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209162752 00000100:00100000:2.0:1788592793.968935:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209162752 00000100:00100000:2.0:1788592793.969002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:2.0:1788592793.969024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11186:x1875475209162752:12345-192.168.203.47@tcp:35:cat.0 00000100:00100000:2.0:1788592793.969330:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:11186:x1875475209162752:12345-192.168.203.47@tcp:35:cat.0 Request processed in 307us (638us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788592793.969338:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:0.0:1788592793.970040:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209162496 00000100:00100000:0.0:1788592793.970047:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209162496 00000100:00100000:0.0:1788592793.970107:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:0.0:1788592793.970115:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:2394:x1875475209162496:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592793.970126:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592793.970146:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db517c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df9 expref: 39 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.970164:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592793.970170:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592793.970716:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:2394:x1875475209162496:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 601us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592793.970725:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1788592794.030482:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592794.030556:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209163008 00000100:00100000:0.0:1788592794.030565:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209163008 00000100:00100000:0.0:1788592794.030701:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:0.0:1788592794.030713:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11192:x1875475209163008:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:0.0:1788592794.030737:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592794.030740:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788592794.030765:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db50e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dcf expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.030786:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592794.030791:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592794.030806:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db518a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e00 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.030970:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.030985:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.030993:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.031025:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.031039:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 38 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592794.031052:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226023296:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592794.031199:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592794.033502:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226023296:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592794.033531:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592794.034909:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592794.035827:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209163136 00000100:00100000:0.0:1788592794.035836:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209163136 00010000:00010000:0.0:1788592794.035877:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 39 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592794.036337:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:0.0:1788592794.036370:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:2395:x1875475209163136:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592794.036386:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592794.036402:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 39 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.036416:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 39 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.036437:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2df2 expref: 39 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.036457:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592794.036462:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.036473:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.036480:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.036513:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592794.036566:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:2395:x1875475209163136:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 201us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592794.036572:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00010000:00010000:2.0:1788592794.036663:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.036672:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592794.036689:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788592794.036851:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db518a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.036878:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.036886:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.036889:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788592794.036892:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1a00, rc 0) 00000100:00100000:2.0:1788592794.036930:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11192:x1875475209163008:12345-192.168.203.47@tcp:101:dd.0 Request processed in 6220us (6591us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788592794.036938:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:3.0:1788592794.041031:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.041264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209163264 00000100:00100000:2.0:1788592794.041272:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209163264 00000100:00100000:2.0:1788592794.041316:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:2.0:1788592794.041326:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11192:x1875475209163264:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:2.0:1788592794.041370:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592794.041585:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db519f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.041636:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.041652:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.041663:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.041974:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db519f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.041992:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.042001:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.042004:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592794.042007:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb000, rc 0) 00000100:00100000:2.0:1788592794.042086:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:11192:x1875475209163264:12345-192.168.203.47@tcp:101:dd.0 Request processed in 740us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592794.042094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1788592794.045237:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592794.045335:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209163520 00000100:00100000:3.0:1788592794.045345:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209163520 00000100:00100000:3.0:1788592794.045410:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:3.0:1788592794.045420:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:11192:x1875475209163520:12345-192.168.203.47@tcp:36:dd.0 00010000:00010000:3.0:1788592794.045653:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.045670:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.045681:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592794.045724:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788592794.045758:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b7241c3 reply state 0000000049ca0de2 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.045771:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.045778:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592794.045781:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592794.045784:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592794.045875:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:11192:x1875475209163520:12345-192.168.203.47@tcp:36:dd.0 Request processed in 456us (645us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788592794.045882:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000020:00080000:3.0:1788592794.045887:0:10029:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592794.222683:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.222776:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209163648 00000100:00100000:2.0:1788592794.222784:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209163648 00000100:00100000:2.0:1788592794.222886:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:2.0:1788592794.222897:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:11206:x1875475209163648:12345-192.168.203.47@tcp:101:stat.0 00010000:00010000:2.0:1788592794.222949:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592794.222970:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e0e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223050:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223096:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223108:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223119:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223126:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223132:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223217:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223228:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223236:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223268:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.223288:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 43 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592794.223302:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226023424:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592794.223540:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184f8f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592794.226031:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876657b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226023424:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592794.226530:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592794.227331:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.227408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209163904 00000100:00100000:2.0:1788592794.227415:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209163904 00000100:00100000:2.0:1788592794.227480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:2.0:1788592794.227487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+44:6160:x1875475209163904:12345-192.168.203.47@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788592794.227757:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+45:6160:x1875475209163904:12345-192.168.203.47@tcp:35:ldlm_bl.0 Request processed in 268us (426us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788592794.227765:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:1.0:1788592794.231017:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.231167:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209164032 00000100:00100000:2.0:1788592794.231271:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209164032 00010000:00010000:2.0:1788592794.231313:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 45 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592794.231360:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:2.0:1788592794.231371:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+45:2395:x1875475209164032:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592794.231386:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592794.231405:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 45 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.231420:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 45 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.231440:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5191 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e00 expref: 45 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.231457:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.231462:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.231472:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.231480:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.231537:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592794.231592:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+44:2395:x1875475209164032:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 223us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592794.231600:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00010000:00010000:3.0:1788592794.231896:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.231908:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592794.232529:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788592794.232535:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592794.232716:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232734:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232744:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232751:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232758:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232765:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592794.232769:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232777:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232790:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592794.232794:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592794.232798:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232804:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db51bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232818:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232825:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232838:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232843:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592794.232846:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232853:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232862:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:3.0:1788592794.232865:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592794.232868:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232874:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232910:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e0e expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232927:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e0e expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.232935:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592794.232937:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592794.232940:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca400, rc 0) 00000100:00100000:3.0:1788592794.233040:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+43:11206:x1875475209163648:12345-192.168.203.47@tcp:101:stat.0 Request processed in 10143us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592794.233057:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:1.0:1788592794.289790:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.289901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209164288 00000100:00100000:2.0:1788592794.289910:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209164288 00000100:00100000:2.0:1788592794.289969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:2.0:1788592794.289978:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+43:11212:x1875475209164288:12345-192.168.203.47@tcp:36:truncate.0 00010000:00010000:2.0:1788592794.290034:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592794.290061:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e0e expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.290124:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.290130:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592794.290300:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.290315:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.290324:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592794.291627:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788592794.291676:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ac9189d reply state 00000000f93e33f9 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.291693:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.291703:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.291705:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592794.291709:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592794.291859:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+45:11212:x1875475209164288:12345-192.168.203.47@tcp:36:truncate.0 Request processed in 1878us (2076us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788592794.291867:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000020:00080000:2.0:1788592794.291872:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592794.406416:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.407054:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209164416 00000100:00100000:2.0:1788592794.407097:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209164416 00000100:00100000:2.0:1788592794.407172:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:2.0:1788592794.407182:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+45:11226:x1875475209164416:12345-192.168.203.47@tcp:101:stat.0 00010000:00010000:2.0:1788592794.407221:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592794.407243:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e15 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407310:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407324:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407336:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407346:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407353:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407360:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407429:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407440:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407447:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592794.407486:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788592794.407496:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592794.407518:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407531:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407540:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407546:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407551:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407556:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.407560:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407568:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407579:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592794.407582:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.407586:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407593:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db51de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407617:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407633:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407639:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407644:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.407648:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407654:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.407662:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:2.0:1788592794.407665:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.407668:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.408520:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db51e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.408696:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db51d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 47 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.408715:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 46 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.408723:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.408726:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592794.408741:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:2.0:1788592794.409118:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:11226:x1875475209164416:12345-192.168.203.47@tcp:101:stat.0 Request processed in 1934us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592794.409129:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:1.0:1788592794.425015:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226023552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592794.425118:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592794.425278:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226023552 00000100:00100000:3.0:1788592794.425286:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226023552 00000100:00100000:3.0:1788592794.425338:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788592794.425356:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226023552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592794.425378:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592794.425421:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226023552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592794.425428:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788592794.425511:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226023552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592794.425805:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226023680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592794.425837:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592794.426013:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226023680 00000100:00100000:1.0:1788592794.426018:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226023680 00000100:00100000:1.0:1788592794.426112:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788592794.426120:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226023680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592794.426132:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592794.426331:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226023680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 212us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592794.426338:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788592794.426449:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226023680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592794.466534:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592794.466655:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209164672 00000100:00100000:3.0:1788592794.466665:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209164672 00000100:00100000:3.0:1788592794.466737:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:3.0:1788592794.466750:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:11236:x1875475209164672:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592794.466769:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592794.466793:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db51f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e1c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592794.466902:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788592794.467014:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db51f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e1c expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.467028:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:3.0:1788592794.467042:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592794.467048:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db51f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e1c expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.467061:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e600, rc 0) 00000100:00100000:3.0:1788592794.467320:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:11236:x1875475209164672:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 570us (793us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788592794.467328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:1.0:1788592794.470903:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.472459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209164928 00000100:00100000:2.0:1788592794.472471:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209164928 00000100:00100000:2.0:1788592794.472542:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592794.472552:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:11236:x1875475209164928:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592794.472811:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+48:11236:x1875475209164928:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 259us (1916us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788592794.472819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592794.526708:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592794.526910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209165184 00000100:00100000:3.0:1788592794.526921:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209165184 00000100:00100000:3.0:1788592794.526980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:3.0:1788592794.526990:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+48:11242:x1875475209165184:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592794.527012:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592794.527032:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5201 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.527183:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.527200:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 49 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.527210:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.527241:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 49 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.527256:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 49 pid: 13208 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592794.527414:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f612300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226023808:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592794.527494:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788592794.530379:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f612300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226023808:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592794.530408:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592794.532612:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592794.533789:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209165312 00000100:00100000:1.0:1788592794.533802:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209165312 00010000:00010000:1.0:1788592794.533846:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 50 pid: 13208 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592794.533969:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:1.0:1788592794.533980:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+50:2395:x1875475209165312:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592794.533999:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592794.534006:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 50 pid: 13208 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.534020:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 50 pid: 13208 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.534042:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db51ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e15 expref: 50 pid: 13208 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.534105:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:1.0:1788592794.534111:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.534120:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.534128:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.534162:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592794.534228:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:2395:x1875475209165312:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 249us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592794.534235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00010000:00010000:3.0:1788592794.534332:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.534341:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592794.534359:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788592794.534498:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5201 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.534513:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.534521:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592794.534524:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788592794.534527:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f400, rc 0) 00000100:00100000:3.0:1788592794.534553:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:11242:x1875475209165184:12345-192.168.203.47@tcp:101:bash.0 Request processed in 7566us (7855us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788592794.534561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:1.0:1788592794.542862:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.542947:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209165568 00000100:00100000:2.0:1788592794.542957:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209165568 00000100:00100000:2.0:1788592794.543017:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:2.0:1788592794.543026:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:11242:x1875475209165568:12345-192.168.203.47@tcp:36:bash.0 00010000:00010000:2.0:1788592794.543276:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.543293:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.543305:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592794.543348:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788592794.543368:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000850aa2ba reply state 00000000e74fd9b5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.543398:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.543405:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.543408:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592794.543412:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592794.543497:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:11242:x1875475209165568:12345-192.168.203.47@tcp:36:bash.0 Request processed in 471us (645us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788592794.543505:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000020:00080000:2.0:1788592794.543510:0:13208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788592794.551491:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592794.551578:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209165696 00000100:00100000:1.0:1788592794.551588:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209165696 00000100:00100000:1.0:1788592794.551658:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:1.0:1788592794.551668:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:11242:x1875475209165696:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:1.0:1788592794.553287:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592794.553317:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db521d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e2a expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.553414:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.553430:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.553456:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.553488:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592794.553504:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 53 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592794.553517:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226023936:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592794.553623:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218587560c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788592794.553971:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592794.564238:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226023936:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592794.564297:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592794.565189:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592794.565714:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209165824 00000100:00100000:0.0:1788592794.565723:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209165824 00010000:00010000:0.0:1788592794.565765:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 54 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592794.565824:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:0.0:1788592794.565836:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:2396:x1875475209165824:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592794.565851:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592794.565858:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 54 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.565871:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 54 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.565893:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5208 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e23 expref: 54 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.565910:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592794.565916:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.565927:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.565935:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.565965:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592794.566022:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592794.566032:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:2396:x1875475209165824:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 197us (845us total) trans 0 rc 0/0 00010000:00010000:3.0:1788592794.566035:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592794.566045:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000004:00200000:3.0:1788592794.566123:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788592794.566129:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592794.566150:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.566183:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db521d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e2a expref: 53 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.566199:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e2a expref: 52 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.566207:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592794.566210:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592794.566213:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839a00, rc 0) 00000100:00100000:3.0:1788592794.566256:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:11242:x1875475209165696:12345-192.168.203.47@tcp:101:bash.0 Request processed in 14588us (14775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592794.566264:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:2.0:1788592794.569756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592794.569855:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209166080 00000100:00100000:1.0:1788592794.569865:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209166080 00000100:00100000:1.0:1788592794.569921:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:1.0:1788592794.569941:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186969a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:11242:x1875475209166080:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:1.0:1788592794.570405:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186969a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:11242:x1875475209166080:12345-192.168.203.47@tcp:35:bash.0 Request processed in 474us (658us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788592794.570414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:1.0:1788592794.649784:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592794.649853:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209166336 00000100:00100000:3.0:1788592794.649865:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209166336 00000100:00100000:3.0:1788592794.649935:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:3.0:1788592794.649946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:11253:x1875475209166336:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592794.649988:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592794.650008:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db522b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592794.650144:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788592794.650258:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db522b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e31 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.650273:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:3.0:1788592794.650276:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592794.650282:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db522b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e31 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.650295:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e600, rc 0) 00000100:00100000:3.0:1788592794.650362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11253:x1875475209166336:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 418us (587us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788592794.650370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:3.0:1788592794.653813:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.654460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209166464 00000100:00100000:2.0:1788592794.654472:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209166464 00000100:00100000:2.0:1788592794.654541:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:2.0:1788592794.654552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11253:x1875475209166464:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:2.0:1788592794.654635:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654658:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654670:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654683:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654706:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654714:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654786:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654797:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654803:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592794.654847:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654859:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654865:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654872:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654878:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.654882:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654890:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.654907:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592794.654910:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.655637:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655656:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5239 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655672:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655678:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655685:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655690:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.655692:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655698:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655707:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:2.0:1788592794.655709:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.655711:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655716:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655738:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655744:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655750:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655755:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.655758:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655763:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655769:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.655771:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.655774:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.655779:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592794.655921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11253:x1875475209166464:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 1358us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592794.655931:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:1.0:1788592794.662030:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.662127:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209166720 00000100:00100000:2.0:1788592794.662141:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209166720 00000100:00100000:2.0:1788592794.662524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:2.0:1788592794.662551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11253:x1875475209166720:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592794.662775:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:11253:x1875475209166720:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 226us (752us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788592794.662783:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:1.0:1788592794.715387:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592794.715474:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209166976 00000100:00100000:3.0:1788592794.715484:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209166976 00000100:00100000:3.0:1788592794.715548:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:3.0:1788592794.715558:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:11256:x1875475209166976:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592794.715580:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592794.715609:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db524e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e38 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715683:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715710:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715723:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715735:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715741:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715747:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715857:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715866:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715873:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592794.715883:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788592794.715966:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715973:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715980:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.715991:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592794.715996:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716005:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716016:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592794.716019:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592794.716023:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716030:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5255 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716043:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716049:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716055:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716059:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592794.716061:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716115:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716133:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:3.0:1788592794.716136:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592794.716139:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716146:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db525c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716184:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db524e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e38 expref: 58 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716198:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e38 expref: 57 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.716205:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592794.716208:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592794.716211:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838800, rc 0) 00000100:00100000:3.0:1788592794.716279:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:11256:x1875475209166976:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 721us (899us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788592794.716287:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:3.0:1788592794.722908:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.723360:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209167104 00000100:00100000:2.0:1788592794.723376:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209167104 00000100:00100000:2.0:1788592794.723462:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:2.0:1788592794.723672:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:11256:x1875475209167104:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:2.0:1788592794.723773:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723795:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723810:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723862:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723869:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723876:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723882:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.723888:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723931:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723955:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.723958:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592794.723964:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.723972:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5271 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592794.724006:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.724093:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:11256:x1875475209167104:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 619us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592794.724103:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:0.0:1788592794.724114:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209167232 00000100:00100000:0.0:1788592794.724146:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209167232 00000100:00100000:0.0:1788592794.724231:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:0.0:1788592794.724246:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:2396:x1875475209167232:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592794.724263:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592794.724289:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e38 expref: 57 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.724310:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592794.724315:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592794.724378:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:2396:x1875475209167232:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 137us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592794.724386:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:1.0:1788592794.726348:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.726522:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209167488 00000100:00100000:2.0:1788592794.726535:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209167488 00000100:00100000:2.0:1788592794.726655:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:2.0:1788592794.726667:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:11256:x1875475209167488:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592794.726966:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:11256:x1875475209167488:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 300us (630us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788592794.726974:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:3.0:1788592794.836689:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.837562:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209167744 00000100:00100000:2.0:1788592794.837578:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209167744 00000100:00100000:2.0:1788592794.837674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 74 00000100:00100000:2.0:1788592794.837687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:11274:x1875475209167744:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:2.0:1788592794.837719:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592794.837746:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5278 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e3f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.839968:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db527f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.840011:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db527f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.840032:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db527f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592794.840052:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788592794.840251:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5278 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e3f expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.840276:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db527f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e3f expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.840287:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.840291:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788592794.840296:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:2.0:1788592794.840413:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11274:x1875475209167744:12345-192.168.203.47@tcp:101:cat.0 Request processed in 2729us (3738us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788592794.840425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 74 00000100:00100000:1.0:1788592794.870606:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592794.870725:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209167872 00000100:00100000:3.0:1788592794.870738:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209167872 00000100:00100000:3.0:1788592794.870859:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:3.0:1788592794.870872:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11275:x1875475209167872:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592794.870915:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592794.870961:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db528d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e46 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.871051:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.871122:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.871148:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592794.871781:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788592794.871787:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592794.871812:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.871849:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db528d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e46 expref: 61 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.871873:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e46 expref: 60 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592794.872004:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592794.872007:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592794.872012:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838800, rc 0) 00000100:00100000:3.0:1788592794.872500:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11275:x1875475209167872:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1628us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592794.872510:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:1.0:1788592794.877491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.877796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209168256 00000100:00100000:2.0:1788592794.877809:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209168256 00000100:00100000:2.0:1788592794.877918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:2.0:1788592794.877930:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11275:x1875475209168256:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592794.878336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11275:x1875475209168256:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 406us (858us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788592794.878362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:1.0:1788592794.880246:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592794.880333:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209168384 00000100:00100000:0.0:1788592794.880342:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209168384 00000100:00100000:0.0:1788592794.880430:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:0.0:1788592794.880441:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11275:x1875475209168384:12345-192.168.203.47@tcp:103:lfs.0 00010000:00010000:0.0:1788592794.880459:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788592794.880492:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e2a expref: 61 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.880516:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db527f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e3f expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.880531:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5121 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2de4 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.880543:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592794.880562:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592794.880623:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11275:x1875475209168384:12345-192.168.203.47@tcp:103:lfs.0 Request processed in 184us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592794.880632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:3.0:1788592794.882665:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592794.883456:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209168512 00000100:00100000:0.0:1788592794.883469:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209168512 00000100:00100000:0.0:1788592794.883540:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:0.0:1788592794.883552:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11275:x1875475209168512:12345-192.168.203.47@tcp:58:lfs.0 00010000:00010000:0.0:1788592794.883730:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.883752:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592794.883766:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592794.884733:0:13208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592794.884891:0:13208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788592794.885786:0:13208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788592794.886427:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11275:x1875475209168512:12345-192.168.203.47@tcp:58:lfs.0 Request processed in 2870us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592794.886440:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:1.0:1788592794.905274:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592794.905416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209168640 00000100:00100000:2.0:1788592794.905430:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209168640 00000100:00100000:2.0:1788592794.905563:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:2.0:1788592794.905576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11277:x1875475209168640:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592794.905614:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592794.905651:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db52a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e4d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905738:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905756:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905769:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905780:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905786:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905793:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905887:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.905948:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592794.906004:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788592794.906010:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592794.906033:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906046:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906055:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906062:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906131:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906139:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.906145:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906156:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906174:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592794.906179:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.906195:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906203:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906224:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906233:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906239:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906246:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592794.906249:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906255:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906264:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:2.0:1788592794.906266:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592794.906269:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906277:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906306:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db52a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906333:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592794.906340:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592794.906343:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788592794.906346:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:2.0:1788592794.906466:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11277:x1875475209168640:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 891us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592794.906476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 77 00000040:00080000:3.0:1788592795.128487:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592795.128501:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592795.128544:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788592795.128558:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788592795.128788:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921876654e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226024064:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592795.128913:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184f8f83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592795.131453:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921876654e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226024064:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592795.131754:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.131990:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209168768 00000100:00100000:3.0:1788592795.132000:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209168768 00000100:00080000:2.0:1788592795.132054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592795.132088:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 78 00000100:00100000:3.0:1788592795.132102:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11288:x1875475209168768:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592795.132535:0:10029:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592795.133111:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11288:x1875475209168768:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 1009us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.133121:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 78 00000100:00100000:1.0:1788592795.139803:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.139954:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209168896 00000100:00100000:0.0:1788592795.139968:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209168896 00000100:00100000:0.0:1788592795.140101:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:0.0:1788592795.140116:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11288:x1875475209168896:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788592795.140246:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140280:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140295:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140458:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140483:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140497:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140535:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140543:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140549:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592795.140622:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788592795.140626:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592795.140639:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140652:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140678:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140685:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140690:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592795.140695:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140703:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140715:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:0.0:1788592795.140718:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592795.140723:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140730:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db52be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140753:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140758:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140764:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140770:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592795.140780:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140786:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140793:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff92184f8fa000) 00010000:00010000:0.0:1788592795.140796:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592795.140798:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140804:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140819:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140824:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140830:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140835:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592795.140837:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140843:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140850:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592795.140853:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592795.140881:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.140890:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592795.140994:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11288:x1875475209168896:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 Request processed in 878us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.141005:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:1.0:1788592795.143814:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.144006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209169152 00000100:00100000:2.0:1788592795.144021:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209169152 00000100:00100000:2.0:1788592795.144354:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:2.0:1788592795.144368:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11288:x1875475209169152:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592795.144396:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592795.144424:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e54 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144592:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144627:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144644:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592795.144657:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788592795.144763:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144773:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144780:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144787:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.144792:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144802:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144817:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592795.144820:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788592795.144826:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144851:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db52da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144910:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e54 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144923:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:2.0:1788592795.144925:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592795.144930:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e54 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.144942:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca400, rc 0) 00000100:00100000:2.0:1788592795.145027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11288:x1875475209169152:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 662us (1227us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788592795.145036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:1.0:1788592795.148522:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.148800:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209169280 00000100:00100000:2.0:1788592795.148812:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209169280 00000100:00100000:2.0:1788592795.149028:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:2.0:1788592795.149038:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11288:x1875475209169280:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592795.149108:0:10029:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592795.149243:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11288:x1875475209169280:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 206us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.149252:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:1.0:1788592795.153648:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.153760:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209169536 00000100:00100000:0.0:1788592795.153773:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209169536 00000100:00100000:0.0:1788592795.153856:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:0.0:1788592795.153878:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11288:x1875475209169536:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592795.153905:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592795.153910:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788592795.153946:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e46 expref: 60 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.153972:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592795.153978:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592795.153996:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e5b expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592795.155782:0:13208:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788592795.156560:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.156581:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.156689:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.156782:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db52e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e5b expref: 62 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.156805:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e5b expref: 61 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.156816:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa000) 00010000:00010000:0.0:1788592795.156819:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592795.156823:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0a00, rc 0) 00000100:00100000:0.0:1788592795.156983:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11288:x1875475209169536:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 3113us (3347us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788592795.156995:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:1.0:1788592795.160259:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.160362:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209169792 00000100:00100000:2.0:1788592795.160375:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209169792 00000100:00100000:2.0:1788592795.160477:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:2.0:1788592795.160508:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11288:x1875475209169792:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592795.160682:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592795.160720:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db52ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e5b expref: 61 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160742:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa000) 00010000:00010000:2.0:1788592795.160755:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592795.160785:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160806:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160818:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160834:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160840:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160847:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160903:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160911:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160991:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.160997:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.161002:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.161012:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.161021:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592795.161024:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592795.161028:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.161035:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db52fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.161046:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.161052:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.163860:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.163870:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.163876:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.163925:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.163948:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd23cd7f (ffff921743723200) 00010000:00010000:2.0:1788592795.163951:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592795.163957:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.163966:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5304 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd23cd7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.164144:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11288:x1875475209169792:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 3632us (3895us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592795.164155:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:1.0:1788592795.168865:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.169360:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209169920 00000100:00100000:0.0:1788592795.169385:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209169920 00000100:00100000:0.0:1788592795.169459:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 84 00000100:00100000:0.0:1788592795.169472:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187591d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11288:x1875475209169920:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592795.169499:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592795.169530:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db530b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e62 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.169574:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.169591:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.169632:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.169777:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db530b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 62 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.169798:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 61 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.169809:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:0.0:1788592795.169813:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592795.169816:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0200, rc 0) 00000100:00100000:0.0:1788592795.169899:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187591d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11288:x1875475209169920:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 430us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.169907:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 84 00000100:00100000:2.0:1788592795.175695:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.175905:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209170176 00000100:00100000:0.0:1788592795.175919:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209170176 00000100:00100000:0.0:1788592795.176219:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:0.0:1788592795.176232:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11288:x1875475209170176:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592795.176353:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.176378:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.176394:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592795.177181:0:13208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788592795.177199:0:13208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329424131222ns, next at 330424127094ns, rc = 0 00000004:00010000:0.0:1788592795.177274:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004cbe7cd reply state 000000000aba8298 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.177293:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.177302:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:0.0:1788592795.177306:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788592795.177311:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592795.177516:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:11288:x1875475209170176:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 1282us (1829us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788592795.177526:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:2.0:1788592795.180412:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.180645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209170304 00000100:00100000:3.0:1788592795.180659:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209170304 00000100:00100000:3.0:1788592795.180735:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:3.0:1788592795.180747:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:11288:x1875475209170304:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592795.180779:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592795.180804:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e69 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.180879:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.180898:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.180926:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:3.0:1788592795.180929:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592795.180933:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839400, rc 0) 00000100:00100000:3.0:1788592795.181014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+64:11288:x1875475209170304:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 269us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.181031:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:3.0:1788592795.188664:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.188784:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209170432 00000100:00100000:2.0:1788592795.188797:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209170432 00000100:00100000:2.0:1788592795.188860:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:2.0:1788592795.188882:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875475209170432:12345-192.168.203.47@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788592795.188933:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:2.0:1788592795.188977:0:8429:0:(genops.c:1385:class_connect()) connect: client 7fa053f8-dea8-45a9-81cb-9946b4fa9e00, cookie 0xbd314a3362db5327 00002000:00100000:2.0:1788592795.188994:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7fa053f8-dea8-45a9-81cb-9946b4fa9e00/ffff9217439bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788592795.189018:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788592795.189146:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788592795.189187:0:8429:0:(import.c:65:import_set_state_nolock()) ffff921845409800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592795.189287:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2392:x1875475209170432:12345-192.168.203.47@tcp:8:lhsmtool_posix.0 Request processed in 404us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.189296:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:2.0:1788592795.197836:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.198013:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209170560 00000100:00100000:1.0:1788592795.198024:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209170560 00000100:00100000:1.0:1788592795.198117:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:1.0:1788592795.198129:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:0:x1875475209170560:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788592795.198929:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788592795.202210:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788592795.202223:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000100:00100000:1.0:1788592795.202361:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:0:x1875475209170560:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 4222us (4522us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788592795.202373:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:3.0:1788592795.207562:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.208034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209170816 00000100:00100000:1.0:1788592795.208043:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209170816 00000100:00100000:1.0:1788592795.208133:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:1.0:1788592795.208143:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+64:11288:x1875475209170816:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592795.208355:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:11288:x1875475209170816:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 212us (800us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788592795.208363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:1.0:1788592795.212680:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.215272:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171072 00000100:00100000:3.0:1788592795.215287:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171072 00000100:00100000:3.0:1788592795.215370:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 87 00000100:00100000:3.0:1788592795.215383:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:11288:x1875475209171072:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788592795.215507:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:11288:x1875475209171072:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 126us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.215515:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 87 00000100:00100000:0.0:1788592795.224411:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.227346:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171200 00000100:00100000:2.0:1788592795.227362:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171200 00000100:00100000:2.0:1788592795.227423:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:2.0:1788592795.227434:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:11288:x1875475209171200:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592795.227454:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592795.227477:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db532e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e70 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.227551:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.227567:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.227579:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592795.227636:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592795.227657:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.227686:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db532e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e70 expref: 67 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.227702:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e70 expref: 66 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.227719:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:2.0:1788592795.227722:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788592795.227726:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80600, rc 0) 00000100:00100000:2.0:1788592795.227865:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:11288:x1875475209171200:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 432us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.227874:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:1.0:1788592795.244180:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.244240:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171328 00000100:00100000:3.0:1788592795.244250:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171328 00000100:00100000:3.0:1788592795.244308:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:3.0:1788592795.244319:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209171328:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592795.244336:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592795.244647:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e77 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592795.244674:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc29b, blocks: 0x0 00010000:00010000:3.0:1788592795.244694:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788592795.244699:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592795.244708:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.244729:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.244751:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838800, rc 0) 00000100:00100000:3.0:1788592795.244812:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209171328:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 494us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.244820:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:1.0:1788592795.247941:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.248020:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171584 00000100:00100000:0.0:1788592795.248030:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171584 00000100:00100000:0.0:1788592795.248121:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00100000:0.0:1788592795.248131:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:11288:x1875475209171584:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788592795.248369:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:11288:x1875475209171584:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 239us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.248378:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00100000:3.0:1788592795.252432:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.252481:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171712 00000100:00100000:3.0:1788592795.252490:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171712 00000100:00100000:3.0:1788592795.252533:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:3.0:1788592795.252541:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:11288:x1875475209171712:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592795.252557:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592795.252573:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e7e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.252612:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.252622:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592795.252627:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592795.252633:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.252665:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.252692:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.252706:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875475226024192:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592795.252784:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592795.256397:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875475226024192:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592795.256435:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.256455:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839a00, rc 0) 00000100:00100000:2.0:1788592795.256523:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11288:x1875475209171712:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 3982us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.256533:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:3.0:1788592795.257504:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.257563:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171840 00000100:00100000:2.0:1788592795.257571:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171840 00010000:00010000:2.0:1788592795.257618:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.257777:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:2.0:1788592795.257799:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209171840:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592795.257814:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592795.257835:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.257862:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.257887:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db533c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e77 expref: 7 pid: 8428 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.257901:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592795.257905:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592795.257915:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.257925:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.257959:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.257973:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1875475226024320:192.168.203.47@tcp:105: 00000100:00100000:2.0:1788592795.265701:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592795.270695:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1875475226024320:192.168.203.47@tcp:105: 00010000:00010000:2.0:1788592795.270723:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592795.270782:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209171840:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 12995us (13281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.270794:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1788592795.274654:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.274738:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209171968 00000100:00100000:3.0:1788592795.274747:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209171968 00002000:00100000:3.0:1788592795.274796:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff921744505880 x1875475209171968/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:71/0 lens 504/0 e 0 to 0 dl 1788592806 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592795.274807:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744505880 with x1875475209171968 ext(0->8) 00002000:00010000:3.0:1788592795.274814:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744505880 00000100:00100000:3.0:1788592795.274848:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:3.0:1788592795.274858:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209171968:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788592795.275962:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209171968:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 Request processed in 1100us (1311us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788592795.275981:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00002000:00100000:3.0:1788592795.275990:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff921744505880 x1875475209171968/t4294967303(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:71/0 lens 504/448 e 0 to 0 dl 1788592806 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592795.275998:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744505880 with x1875475209171968 ext(0->8) 00002000:00010000:3.0:1788592795.276002:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744505880 00000100:00100000:1.0:1788592795.280820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.280901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209172096 00000100:00100000:3.0:1788592795.280923:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209172096 00000100:00100000:3.0:1788592795.280981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 90 00000100:00100000:3.0:1788592795.280991:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:11288:x1875475209172096:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788592795.287122:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788592795.287138:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1788592795.287212:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788592795.287229:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92184384ae40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788592795.287233:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921743758700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92184384a540 00000020:00080000:3.0:1788592795.287237:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921743758400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff921845766000 00000020:00080000:3.0:1788592795.287404:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788592795.287609:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788592795.287630:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226024448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788592795.287701:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592795.287742:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592795.287753:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226024576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788592795.287791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592795.287833:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226024448 00000100:00100000:3.0:1788592795.287840:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226024448 00000100:00100000:3.0:1788592795.287894:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226024576 00000100:00100000:3.0:1788592795.287898:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226024576 00000100:00100000:3.0:1788592795.287922:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592795.287931:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226024448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788592795.288032:0:8590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788592795.288036:0:8590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788592795 00002000:00010000:3.0:1788592795.288039:0:8590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788592795.288042:0:8590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788592795 -> 1788592795 00002000:00010000:3.0:1788592795.288044:0:8590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788592795.288124:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226024448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (423us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788592795.288133:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592795.288159:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592795.288170:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226024576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788592795.288199:0:8590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788592795.288227:0:8590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9bc299, atime: 0x6a9bc299, ctime: 0x6a9bc299, blocks: 0x8 00010000:00010000:3.0:1788592795.288236:0:8590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288253:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788592795.288258:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592795.288265:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288282:0:8590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288293:0:8590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288302:0:8590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288321:0:8590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788592795.288436:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1875475226024576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (646us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788592795.288452:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788592795.288480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592795.288486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788592795.288499:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592795.288506:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288515:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592795.288520:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288530:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288547:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288554:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000648398d9/0xbd314a3362db534a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.288574:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592795.288577:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592795.288581:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592795.288687:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11288:x1875475209172096:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 Request processed in 7696us (7874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.288697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 90 00000004:00080000:3.0:1788592795.288744:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92186f610a80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788592795.288757:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226024576:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788592795.288776:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92186f611f80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788592795.288780:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226024448:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788592795.289389:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289400:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289407:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289413:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289418:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289424:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289437:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff921743723e00) 00010000:00010000:1.0:1788592795.289441:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.289446:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289451:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db505d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289474:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289480:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289493:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289499:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289502:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289508:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289516:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:1.0:1788592795.289518:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.289521:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289526:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5064 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289539:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289545:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289551:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289555:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289557:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289573:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289583:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723100) 00010000:00010000:1.0:1788592795.289585:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.289616:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289622:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db50a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289644:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289651:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289657:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289662:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289665:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289670:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289679:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:1.0:1788592795.289681:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.289684:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289700:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db51ad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289713:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289718:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289724:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289728:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cba00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289731:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289736:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289744:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:1.0:1788592795.289746:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.289749:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289754:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db51d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289764:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289770:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289782:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289787:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289790:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289797:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289805:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:1.0:1788592795.289808:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.289811:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289817:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db5216 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289829:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289836:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289841:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289846:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.289849:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289864:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289873:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:1.0:1788592795.289875:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788592795.289878:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.289884:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5319 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.294979:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.295025:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209172224 00000100:00100000:3.0:1788592795.295034:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209172224 00000100:00100000:3.0:1788592795.295110:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:3.0:1788592795.295120:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2393:x1875475209172224:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788592795.297251:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788592795.297265:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788592795.297371:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209172224:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 Request processed in 2248us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592795.297384:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:1.0:1788592795.301129:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.301332:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209172480 00000100:00100000:2.0:1788592795.301341:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209172480 00000100:00100000:2.0:1788592795.301407:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 91 00000100:00100000:2.0:1788592795.301418:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:11288:x1875475209172480:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592795.301484:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592795.301511:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e70 expref: 14 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.301528:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:2.0:1788592795.301533:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592795.301561:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.301575:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.301585:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592795.301712:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b5511ef reply state 000000005295e1e7 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.301725:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.301732:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:2.0:1788592795.301734:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592795.301737:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592795.301831:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:11288:x1875475209172480:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 415us (710us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788592795.301849:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 91 00000100:00100000:3.0:1788592795.305462:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.305593:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209172608 00000100:00100000:0.0:1788592795.305612:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209172608 00000100:00100000:0.0:1788592795.305795:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:0.0:1788592795.305807:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209172608:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788592795.305980:0:10091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788592795.305984:0:10091:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788592795 -> 1788592794 00002000:00010000:0.0:1788592795.305987:0:10091:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788592793 00002000:00010000:0.0:1788592795.305990:0:10091:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788592795 -> 1788592794 00002000:00010000:0.0:1788592795.305992:0:10091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788592795.308544:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209172608:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 2730us (3081us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788592795.308568:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:3.0:1788592795.313091:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.313355:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209172864 00000100:00100000:2.0:1788592795.313365:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209172864 00000100:00100000:2.0:1788592795.313414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00100000:2.0:1788592795.313424:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:11288:x1875475209172864:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788592795.313482:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.313498:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 15 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.313507:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.313536:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 15 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.313547:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 15 pid: 10029 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.313559:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226024704:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592795.314133:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592795.318330:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.318368:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209172992 00000100:00100000:3.0:1788592795.318386:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209172992 00010000:00010000:3.0:1788592795.318427:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 16 pid: 10029 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.318475:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:3.0:1788592795.318485:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:2395:x1875475209172992:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592795.318500:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592795.318507:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 16 pid: 10029 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.318520:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 16 pid: 10029 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.318543:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:3.0:1788592795.318556:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.318567:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.318575:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.318609:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592795.318866:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:2395:x1875475209172992:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 382us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.318876:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00010000:00010000:2.0:1788592795.320478:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5312 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e62 expref: 15 pid: 10029 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.320501:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226024704:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592795.320539:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320548:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320617:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320729:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320737:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320745:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320750:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.320754:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320761:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320776:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:2.0:1788592795.320780:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788592795.320784:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.320790:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db5358 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.320860:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:11288:x1875475209172864:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 Request processed in 7434us (7805us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788592795.321232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00100000:3.0:1788592795.326037:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.326809:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209173120 00000100:00100000:2.0:1788592795.326819:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209173120 00000100:00100000:2.0:1788592795.326929:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:2.0:1788592795.326940:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2393:x1875475209173120:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788592795.326981:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.327002:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.327011:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592795.327014:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592795.327019:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.327052:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.327081:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 7 pid: 8429 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.327097:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875475226024832:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592795.327186:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592795.332926:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.332994:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209173248 00000100:00100000:1.0:1788592795.333014:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209173248 00000100:00100000:0.0:1788592795.333030:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875475226024832:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592795.333050:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 8 pid: 8429 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333053:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592795.333105:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1788592795.333114:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209173248:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592795.333128:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592795.333149:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 8 pid: 8429 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.333368:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 8 pid: 8429 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.333394:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da6be5a1/0xbd314a3362db5343 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e7e expref: 8 pid: 8429 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.333409:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592795.333413:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592795.333421:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.333430:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.333464:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592795.333517:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209173248:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 403us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592795.333525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00010000:00010000:0.0:1788592795.333634:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333644:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333664:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333672:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333679:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333692:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592795.333696:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333704:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333716:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.333723:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db535f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592795.333781:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209173120:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 Request processed in 6842us (7753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.333789:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:0.0:1788592795.338511:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.338812:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209173504 00000100:00100000:3.0:1788592795.338822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209173504 00000100:00100000:3.0:1788592795.338924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 93 00000100:00100000:3.0:1788592795.338935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:11288:x1875475209173504:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788592795.339030:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.339064:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.339123:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.339160:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.339303:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 14 pid: 6514 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.339320:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744467100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226024960:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592795.339404:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592795.347953:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.348128:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209173632 00000100:00100000:0.0:1788592795.348137:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209173632 00010000:00010000:0.0:1788592795.348175:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 15 pid: 6514 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.348217:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744467100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226024960:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592795.348217:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:0.0:1788592795.348226:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:2395:x1875475209173632:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592795.348239:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592795.348240:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348252:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 15 pid: 6514 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348263:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 15 pid: 6514 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348286:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db51a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e07 expref: 15 pid: 6514 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348301:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:0.0:1788592795.348306:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348316:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348323:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.348341:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592795.348367:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.348375:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592795.348396:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:2395:x1875475209173632:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 172us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.348404:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00010000:00010000:2.0:1788592795.348573:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.348586:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.348602:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.348630:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.348959:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 14 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.348974:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226025088:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592795.349058:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592795.351821:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226025088:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592795.351858:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592795.355147:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.355224:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209173760 00000100:00100000:0.0:1788592795.355234:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209173760 00010000:00010000:0.0:1788592795.355272:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 15 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592795.355315:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:0.0:1788592795.355325:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:2394:x1875475209173760:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592795.355349:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592795.355356:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 15 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.355370:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 15 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.355392:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5320 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e69 expref: 15 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.355407:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:0.0:1788592795.355413:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.355423:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.355431:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.355457:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592795.355508:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:2394:x1875475209173760:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 184us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.355515:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00010000:00010000:2.0:1788592795.355811:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.355821:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592795.355934:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788592795.356062:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788592795.356181:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788592795.357931:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1875475226025216:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788592795.358001:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592795.358042:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592795.358328:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226025216 00000100:00100000:3.0:1788592795.358336:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226025216 00000100:00100000:3.0:1788592795.358394:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788592795.358403:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875475226025216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788592795.358497:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875475226025216:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.358505:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788592795.358524:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788592795.358529:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92186f611f80, transno 4294967304 00000100:00100000:2.0:1788592795.358553:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1875475226025216:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788592795.358751:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788592795.358803:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1875475226025344:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788592795.358833:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592795.358900:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592795.358982:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226025344 00000100:00100000:0.0:1788592795.358988:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226025344 00000100:00100000:0.0:1788592795.359024:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788592795.359032:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875475226025344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788592795.362652:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1875475226025344:12345-0@lo:1000:mdt00_002.0 Request processed in 3613us (3809us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788592795.362679:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788592795.363929:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1875475226025344:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788592795.363985:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.363996:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364019:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364025:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.364029:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364038:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364053:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:2.0:1788592795.364056:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592795.364060:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364707:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80600/0xbd314a3362db536d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364742:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364749:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364755:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364761:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.364764:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364785:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364795:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592795.364798:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592795.364802:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364809:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db529b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364833:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364847:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364856:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364893:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.364909:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 17 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.364924:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226025472:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592795.365096:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592795.371131:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.371210:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209173888 00000100:00100000:3.0:1788592795.371220:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209173888 00010000:00010000:3.0:1788592795.371261:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 18 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.371307:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1788592795.371318:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:2396:x1875475209173888:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592795.371333:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592795.371340:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 18 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.371354:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 18 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.371393:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:3.0:1788592795.371399:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.371409:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.371416:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.371434:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592795.371437:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db52b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e4d expref: 18 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.371460:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226025472:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592795.371482:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.371489:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:2396:x1875475209173888:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 174us (368us total) trans 0 rc 0/0 00010000:00010000:2.0:1788592795.371491:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.371497:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00010000:00010000:2.0:1788592795.371497:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.371508:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.371514:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.371521:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.371526:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.371531:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.371538:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372132:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592795.372136:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592795.372141:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372159:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5374 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372173:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372179:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372185:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372190:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.372193:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372200:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372208:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8fac00) 00010000:00010000:2.0:1788592795.372211:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592795.372214:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.372220:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5366 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.372376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11288:x1875475209173504:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 33440us (33868us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788592795.372384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 93 00000020:00080000:2.0:1788592795.372394:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788592795.372761:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592795.372766:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592795.372785:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788592795.372791:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592795.376674:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.376840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174144 00000100:00100000:2.0:1788592795.376851:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174144 00000100:00100000:2.0:1788592795.376912:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:2.0:1788592795.376923:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11288:x1875475209174144:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788592795.377450:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788592795.377485:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788592795.377518:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.377536:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.377547:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.377556:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.377562:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.377568:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.377715:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788592795.377852:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:11288:x1875475209174144:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 928us (1185us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788592795.377862:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000020:00080000:2.0:1788592795.377868:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788592795.378326:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592795.378335:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.378344:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592795.378348:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.378357:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.378371:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:3.0:1788592795.378374:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788592795.378379:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.378404:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db537b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.378417:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592795.378419:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592795.378421:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592795.501653:0:14196:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592795.501669:0:14196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592795.501708:0:14196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788592795.501717:0:14196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788592795.576173:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592795.579805:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.579896:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.579927:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.579972:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174656 00000100:00100000:2.0:1788592795.579981:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174656 00000100:00100000:2.0:1788592795.580042:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 100 00000100:00100000:2.0:1788592795.580052:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209174656:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592795.580139:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209174656:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.580148:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 100 00000100:00080000:2.0:1788592795.580169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592795.581314:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.581341:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174912 00000100:00100000:1.0:1788592795.581341:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174400 00000100:00100000:2.0:1788592795.581347:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174912 00000100:00100000:1.0:1788592795.581347:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174400 00000100:00100000:1.0:1788592795.581394:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 240 00000100:00100000:1.0:1788592795.581402:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:2395:x1875475209174400:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592795.581416:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 241 00000100:00100000:2.0:1788592795.581422:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209174912:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592795.581471:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209174912:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 48us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.581478:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 241 00000100:00100000:1.0:1788592795.581517:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:2395:x1875475209174400:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 115us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.581575:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.581603:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 240 00000100:00100000:1.0:1788592795.581617:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174528 00000100:00100000:1.0:1788592795.581620:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174528 00000100:00100000:0.0:1788592795.581712:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.581743:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.581767:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174784 00000100:00100000:0.0:1788592795.581771:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174784 00000100:00100000:2.0:1788592795.581833:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209175040 00000100:00100000:2.0:1788592795.581837:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209175040 00000100:00100000:0.0:1788592795.581853:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:0.0:1788592795.581860:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209174784:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592795.581888:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209174784:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.581897:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:0.0:1788592795.581917:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209174272 00000100:00100000:0.0:1788592795.581919:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209174272 00000100:00100000:0.0:1788592795.581938:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 371 00000100:00100000:0.0:1788592795.581943:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209174272:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592795.581963:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2396:x1875475209174272:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 20us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.581968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 371 00000100:00080000:3.0:1788592795.584864:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592795.584873:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592795.585266:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 242 00000100:00100000:1.0:1788592795.585279:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209174528:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592795.585365:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209174528:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 90us (4055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592795.585373:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 242 00000100:00100000:2.0:1788592795.585935:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 243 00000100:00100000:2.0:1788592795.585944:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209175040:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592795.585985:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209175040:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 42us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.585991:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 243 00000100:00100000:2.0:1788592795.598128:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.598301:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209175296 00000100:00100000:0.0:1788592795.598312:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209175296 00000100:00100000:0.0:1788592795.598373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:0.0:1788592795.598391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:11298:x1875475209175296:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592795.598418:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592795.598439:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e85 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.598546:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5389 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.598561:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5389 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.598572:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5389 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592795.598582:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788592795.598695:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e85 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.598711:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5389 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e85 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.598719:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592795.598722:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592795.598725:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0600, rc 0) 00000100:00100000:0.0:1788592795.598789:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11298:x1875475209175296:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 407us (669us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788592795.598796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:3.0:1788592795.608575:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.608622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209175424 00000100:00100000:3.0:1788592795.608631:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209175424 00000100:00100000:3.0:1788592795.608676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:3.0:1788592795.608685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11298:x1875475209175424:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:3.0:1788592795.608756:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608774:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608786:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608800:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608807:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608812:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608906:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608915:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608921:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592795.608966:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608978:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608985:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608992:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.608998:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.609002:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609010:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592795.609025:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592795.609030:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609043:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5397 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609056:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609062:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609231:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609237:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.609240:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609246:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609255:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176a00) 00010000:00010000:3.0:1788592795.609257:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592795.609260:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609266:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db539e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609281:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609288:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609300:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609305:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cbc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.609308:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609314:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609323:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592795.609325:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592795.609329:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.609335:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.609408:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11298:x1875475209175424:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 723us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.609416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:2.0:1788592795.649500:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.649602:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209175680 00000100:00100000:0.0:1788592795.649612:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209175680 00000100:00100000:0.0:1788592795.649697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:0.0:1788592795.649724:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11301:x1875475209175680:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592795.649746:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592795.649768:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db53ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.649844:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.649858:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.649870:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.649884:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.649891:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.649897:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650011:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650019:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650025:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592795.650045:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788592795.650368:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650377:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650384:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650390:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592795.650394:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650403:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650415:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592795.650418:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592795.650421:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650427:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650438:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650444:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650460:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650466:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592795.650469:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650475:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650483:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff92184f8fa100) 00010000:00010000:0.0:1788592795.650485:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592795.650489:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650494:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650533:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db53ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650547:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.650554:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:0.0:1788592795.650556:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592795.650558:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0a00, rc 0) 00000100:00100000:0.0:1788592795.650670:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11301:x1875475209175680:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 949us (1180us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788592795.650688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:3.0:1788592795.653466:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.653564:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209175808 00000100:00100000:1.0:1788592795.653576:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209175808 00000100:00100000:1.0:1788592795.653642:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:1.0:1788592795.653653:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11301:x1875475209175808:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:1.0:1788592795.653720:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653737:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653749:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653784:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653804:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653811:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653817:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.653821:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653828:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653841:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:1.0:1788592795.653844:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592795.653849:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.653856:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db53cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592795.653939:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11301:x1875475209175808:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 287us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592795.653947:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:3.0:1788592795.656399:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.656458:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209176064 00000100:00100000:2.0:1788592795.656472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209176064 00000100:00100000:2.0:1788592795.656525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:2.0:1788592795.656535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186969a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11301:x1875475209176064:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592795.656774:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186969a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:11301:x1875475209176064:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 239us (382us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788592795.656782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:2.0:1788592795.691450:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.691712:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209176320 00000100:00100000:3.0:1788592795.691724:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209176320 00000100:00100000:3.0:1788592795.691831:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 98 00000100:00100000:3.0:1788592795.691843:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:10828:x1875475209176320:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592795.691870:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592795.691890:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db53d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e93 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.692033:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.692061:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.692114:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.692156:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.692176:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 24 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.692189:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744466a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226025600:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592795.692264:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592795.698355:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.698456:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209176448 00000100:00100000:0.0:1788592795.698465:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209176448 00010000:00010000:0.0:1788592795.698505:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 25 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592795.698549:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:0.0:1788592795.698559:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:2395:x1875475209176448:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592795.698575:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592795.698582:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 25 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.698604:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 25 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.698626:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:0.0:1788592795.698630:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.698640:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.698648:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.698666:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592795.698717:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:2395:x1875475209176448:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 159us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.698744:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00010000:00010000:2.0:1788592795.699141:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db53c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e8c expref: 24 pid: 6512 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.699157:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744466a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226025600:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592795.699176:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.699185:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.699190:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592795.699209:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788592795.699328:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db53d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 25 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.699346:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 24 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.699361:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:2.0:1788592795.699364:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788592795.699367:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cbc00, rc 0) 00000100:00100000:2.0:1788592795.699455:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:10828:x1875475209176320:12345-192.168.203.47@tcp:101:bash.0 Request processed in 7614us (8017us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788592795.699462:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 98 00000100:00100000:3.0:1788592795.706847:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592795.707011:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209176576 00000100:00100000:0.0:1788592795.707022:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209176576 00000100:00100000:0.0:1788592795.707108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:0.0:1788592795.707119:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:10828:x1875475209176576:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592795.707142:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592795.707163:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2e9a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.707199:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.707213:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.707231:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.707345:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db53eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e9a expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.707362:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e9a expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.707371:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:0.0:1788592795.707374:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592795.707377:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1800, rc 0) 00000100:00100000:0.0:1788592795.707440:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:10828:x1875475209176576:12345-192.168.203.47@tcp:101:bash.0 Request processed in 323us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592795.707455:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:1.0:1788592795.712701:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.713390:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209176832 00000100:00100000:3.0:1788592795.713401:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209176832 00000100:00100000:3.0:1788592795.713590:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 100 00000100:00100000:3.0:1788592795.713613:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:10828:x1875475209176832:12345-192.168.203.47@tcp:36:bash.0 00010000:00010000:3.0:1788592795.713838:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.713855:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.713880:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592795.713924:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788592795.713945:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004eb7401e reply state 000000004c376459 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.713957:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.713964:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:3.0:1788592795.713967:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592795.713970:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788592795.714006:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788592795.714186:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:10828:x1875475209176832:12345-192.168.203.47@tcp:36:bash.0 Request processed in 575us (1493us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788592795.714193:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 100 00000020:00080000:3.0:1788592795.714199:0:10029:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788592795.718268:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.718383:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209176960 00000100:00100000:3.0:1788592795.718392:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209176960 00000100:00100000:3.0:1788592795.718555:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:3.0:1788592795.718566:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:10828:x1875475209176960:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592795.718589:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592795.718618:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5400 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ea1 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.718678:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5400 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea1 expref: 30 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.718713:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5400 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea1 expref: 30 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.718732:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:3.0:1788592795.718736:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592795.718739:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca600, rc 0) 00000100:00100000:3.0:1788592795.718803:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:10828:x1875475209176960:12345-192.168.203.47@tcp:101:bash.0 Request processed in 239us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.718811:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:0.0:1788592795.721965:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.723599:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209177088 00000100:00100000:2.0:1788592795.723611:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209177088 00000100:00100000:2.0:1788592795.723742:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:2.0:1788592795.723753:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:10828:x1875475209177088:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592795.723770:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592795.723791:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ea8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592795.723811:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bc29a, atime: 0x6a9bc299, ctime: 0x6a9bc29a, blocks: 0x8 00010000:00010000:2.0:1788592795.723829:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788592795.723833:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592795.723839:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.723851:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.723862:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80600, rc 0) 00000100:00100000:2.0:1788592795.723936:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:10828:x1875475209177088:12345-192.168.203.47@tcp:101:bash.0 Request processed in 185us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.723943:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:1.0:1788592795.726795:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.726881:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209177216 00000100:00100000:3.0:1788592795.726890:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209177216 00002000:00010000:3.0:1788592795.726936:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788592795.726940:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744505c00 with x1875475209177216 ext(0->18446744073709551615) 00002000:00010000:3.0:1788592795.726951:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744505c00. 00000100:00100000:3.0:1788592795.726979:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:3.0:1788592795.726987:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2393:x1875475209177216:12345-192.168.203.47@tcp:10:bash.0 00002000:00010000:3.0:1788592795.727564:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788592795.727569:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788592794 -> 1788592795 00002000:00010000:3.0:1788592795.727572:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788592793 -> 1788592793 00002000:00010000:3.0:1788592795.727574:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788592794 -> 1788592795 00002000:00010000:3.0:1788592795.727577:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788592795.727642:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2393:x1875475209177216:12345-192.168.203.47@tcp:10:bash.0 Request processed in 654us (854us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788592795.727650:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00002000:00010000:3.0:1788592795.727653:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788592795.727665:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744505c00 with x1875475209177216 ext(0->18446744073709551615) 00002000:00010000:3.0:1788592795.727670:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744505c00. 00000100:00100000:3.0:1788592795.808880:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.810543:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209177344 00000100:00100000:1.0:1788592795.810557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209177344 00000100:00100000:1.0:1788592795.810641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 102 00000100:00100000:1.0:1788592795.810653:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11315:x1875475209177344:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:1.0:1788592795.810737:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810755:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810769:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810785:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810803:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810810:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810889:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810899:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810906:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592795.810951:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810962:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810979:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810986:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.810993:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.810997:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811005:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811017:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:1.0:1788592795.811021:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.811026:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811032:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db540e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811048:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811054:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811060:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811122:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.811133:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811141:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811149:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9218765de800) 00010000:00010000:1.0:1788592795.811152:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.811155:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811160:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811175:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811181:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811186:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811191:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592795.811194:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811199:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811206:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:1.0:1788592795.811208:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592795.811217:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592795.811223:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db541c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592795.811301:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11315:x1875475209177344:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 649us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592795.811310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 102 00000100:00100000:0.0:1788592795.849848:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.849950:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209177600 00000100:00100000:3.0:1788592795.849960:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209177600 00000100:00100000:3.0:1788592795.850020:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:3.0:1788592795.850031:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11318:x1875475209177600:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592795.850051:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592795.850319:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db5423 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2eaf expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850392:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850406:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850417:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850430:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850437:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850443:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850547:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5438 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850568:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850576:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592795.850587:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788592795.850679:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850686:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850693:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850698:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.850702:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850710:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850721:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592795.850724:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592795.850729:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850735:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db542a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850748:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850761:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850767:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850772:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cba00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.850776:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850782:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850791:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:3.0:1788592795.850793:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592795.850796:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850801:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850842:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db5423 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eaf expref: 33 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850856:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5438 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eaf expref: 32 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.850864:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:3.0:1788592795.850866:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788592795.850876:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:3.0:1788592795.851325:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11318:x1875475209177600:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1293us (1483us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788592795.851335:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:0.0:1788592795.854816:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.855000:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209177728 00000100:00100000:3.0:1788592795.855011:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209177728 00000100:00100000:3.0:1788592795.855193:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 104 00000100:00100000:3.0:1788592795.855204:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11318:x1875475209177728:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:3.0:1788592795.855270:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.855286:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 32 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.855296:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.855329:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 32 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.855344:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 32 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.855359:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744464e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226025728:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592795.855448:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592795.858130:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.858390:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744464e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226025728:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592795.858417:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592795.859113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209177984 00000100:00100000:1.0:1788592795.859122:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209177984 00000100:00100000:1.0:1788592795.859174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:1.0:1788592795.859184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:6159:x1875475209177984:12345-192.168.203.47@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788592795.859466:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:6159:x1875475209177984:12345-192.168.203.47@tcp:35:ldlm_bl.0 Request processed in 282us (1343us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788592795.859474:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:0.0:1788592795.862433:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.862526:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209178112 00000100:00100000:3.0:1788592795.862536:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209178112 00010000:00010000:3.0:1788592795.862573:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 34 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.862620:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:3.0:1788592795.862630:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:2396:x1875475209178112:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592795.862644:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592795.862650:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 34 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.862664:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 34 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.862687:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db53dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e93 expref: 34 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.862704:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:3.0:1788592795.862709:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.862718:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.862726:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.862762:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592795.862807:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862818:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592795.862844:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:2396:x1875475209178112:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592795.862853:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00010000:00010000:2.0:1788592795.862860:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862867:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862879:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862883:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.862886:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862892:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862899:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:2.0:1788592795.862902:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592795.862905:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.862909:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5446 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592795.862961:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11318:x1875475209177728:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 7758us (8153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592795.862969:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 104 00000100:00100000:0.0:1788592795.869304:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592795.870110:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209178368 00000100:00100000:1.0:1788592795.870121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209178368 00000100:00100000:1.0:1788592795.870228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:1.0:1788592795.870238:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:11318:x1875475209178368:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:1.0:1788592795.870449:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:11318:x1875475209178368:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 212us (1153us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788592795.870456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:1.0:1788592795.958816:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.958881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209178624 00000100:00100000:2.0:1788592795.958891:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209178624 00000100:00100000:2.0:1788592795.958951:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:2.0:1788592795.958961:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:11329:x1875475209178624:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:2.0:1788592795.959738:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592795.959760:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db544d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2eb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.959832:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.959847:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.959858:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.959874:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.959880:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.959886:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960017:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960026:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960033:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592795.960041:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788592795.960130:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960137:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960143:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960148:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.960151:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960158:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960170:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592795.960173:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592795.960177:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960193:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5454 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960207:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960213:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960219:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960225:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592795.960228:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960234:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960242:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921743723200) 00010000:00010000:2.0:1788592795.960244:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592795.960247:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960252:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db545b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960290:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db544d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eb6 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960303:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eb6 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592795.960318:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:2.0:1788592795.960321:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592795.960323:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839400, rc 0) 00000100:00100000:2.0:1788592795.960395:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11329:x1875475209178624:12345-192.168.203.47@tcp:101:cat.0 Request processed in 1435us (1588us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788592795.960403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:0.0:1788592795.964859:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592795.964953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209178880 00000100:00100000:2.0:1788592795.964963:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209178880 00000100:00100000:2.0:1788592795.965104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:2.0:1788592795.965115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11329:x1875475209178880:12345-192.168.203.47@tcp:35:cat.0 00000100:00100000:2.0:1788592795.965419:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+36:11329:x1875475209178880:12345-192.168.203.47@tcp:35:cat.0 Request processed in 305us (569us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788592795.965428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:0.0:1788592795.985482:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592795.985575:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209179136 00000100:00100000:3.0:1788592795.985586:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209179136 00000100:00100000:3.0:1788592795.985660:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 106 00000100:00100000:3.0:1788592795.985670:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+36:11330:x1875475209179136:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1788592795.985729:0:10029:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788592795.985758:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5400 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea1 expref: 36 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985780:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eb6 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985792:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db5438 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eaf expref: 34 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985804:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db53f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e9a expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985813:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:3.0:1788592795.985818:0:10029:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592795.985839:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985853:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985863:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985893:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985900:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.985906:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.986859:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.986873:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.986881:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592795.987131:0:10029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:3.0:1788592795.987177:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987185:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987192:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987200:0:10029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987206:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987222:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987237:0:10029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592795.987257:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987263:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987268:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987274:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.987278:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987286:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987298:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:3.0:1788592795.987301:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788592795.987306:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987312:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db547e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987329:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987335:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987347:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987351:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592795.987354:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987360:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987368:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592795.987371:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592795.987374:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987380:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5470 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592795.987390:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d905166 reply state 00000000066d0281 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987400:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592795.987406:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:3.0:1788592795.987408:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592795.987411:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592795.987500:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:11330:x1875475209179136:12345-192.168.203.47@tcp:36:rm.0 Request processed in 1828us (2025us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788592795.987508:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 106 00010000:00010000:0.0:1788592795.988207:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592795.988215:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.988222:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592795.988225:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.988231:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.988242:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:0.0:1788592795.988245:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592795.988248:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.988253:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5485 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592795.988264:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592795.988273:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592795.988274:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592796.039820:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.039925:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209179392 00000100:00100000:2.0:1788592796.039935:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209179392 00000100:00100000:2.0:1788592796.040001:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 107 00000100:00100000:2.0:1788592796.040012:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:11336:x1875475209179392:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592796.040035:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592796.040062:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db548c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ebd expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.040195:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.040209:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.040233:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.040245:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.040251:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.040257:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592796.040611:0:13208:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788592796.040990:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041001:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041009:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041040:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041127:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041136:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041142:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592796.041154:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041225:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041238:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592796.041241:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592796.041246:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041252:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db5493 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592796.041267:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0bfe41c reply state 000000008a5e049a transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041278:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041285:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:2.0:1788592796.041287:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592796.041290:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788592796.041319:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db548c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 37 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041334:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 36 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.041341:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:2.0:1788592796.041344:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592796.041354:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80400, rc 0) 00000100:00100000:2.0:1788592796.041801:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:11336:x1875475209179392:12345-192.168.203.47@tcp:101:bash.0 Request processed in 1788us (1989us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788592796.041810:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 107 00000100:00100000:1.0:1788592796.049649:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.052487:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209179520 00000100:00100000:2.0:1788592796.052502:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209179520 00000100:00100000:2.0:1788592796.052580:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:2.0:1788592796.052603:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209179520:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592796.052624:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592796.052646:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ec4 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592796.053046:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592796.053085:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1788592796.053090:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592796.053100:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.053178:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.053193:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81c00, rc 0) 00000100:00100000:2.0:1788592796.053256:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209179520:12345-192.168.203.47@tcp:101:bash.0 Request processed in 666us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.053264:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:1.0:1788592796.056409:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.056576:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209179648 00000100:00100000:0.0:1788592796.056586:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209179648 00000100:00100000:0.0:1788592796.056657:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:0.0:1788592796.056669:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:11336:x1875475209179648:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592796.056686:0:8590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592796.056705:0:8590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ecb expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.056737:0:8590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.056747:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592796.056751:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592796.056757:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 9 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.056789:0:8590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.056803:0:8590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.056817:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226025856:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592796.056904:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592796.059169:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226025856:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592796.059219:0:8590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 9 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.059241:0:8590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0000, rc 0) 00000100:00100000:2.0:1788592796.059357:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:11336:x1875475209179648:12345-192.168.203.47@tcp:101:bash.0 Request processed in 2688us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.059366:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:2.0:1788592796.060121:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.060221:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209179776 00000100:00100000:0.0:1788592796.060228:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209179776 00010000:00010000:0.0:1788592796.060259:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.060331:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:0.0:1788592796.060341:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209179776:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592796.060356:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592796.060379:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.060392:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.060413:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3a3503/0xbd314a3362db54af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ec4 expref: 9 pid: 8427 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.060428:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592796.060433:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592796.060440:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.060449:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.060482:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.060523:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f610e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1875475226025984:192.168.203.47@tcp:105: 00000100:00100000:0.0:1788592796.060602:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592796.063823:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f610e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1875475226025984:192.168.203.47@tcp:105: 00010000:00010000:0.0:1788592796.063852:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592796.063914:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209179776:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3574us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592796.063925:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:2.0:1788592796.064447:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592796.065506:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209180032 00000100:00100000:1.0:1788592796.065640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209180032 00000100:00100000:1.0:1788592796.065691:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:1.0:1788592796.065701:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:11336:x1875475209180032:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:1.0:1788592796.066035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11336:x1875475209180032:12345-192.168.203.47@tcp:35:bash.0 Request processed in 333us (1589us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788592796.066043:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1788592796.201859:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.202340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209180160 00000100:00100000:0.0:1788592796.202349:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209180160 00000100:00100000:0.0:1788592796.202443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 108 00000100:00100000:0.0:1788592796.202452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:11352:x1875475209180160:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592796.202473:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592796.202490:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db54bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ed2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.202543:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db54c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.202565:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db54c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.202579:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db54c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592796.202631:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788592796.202636:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592796.202668:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db54c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.202698:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db54bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ed2 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.202716:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db54c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ed2 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.202725:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592796.202728:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592796.202732:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1000, rc 0) 00000100:00100000:0.0:1788592796.202830:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:11352:x1875475209180160:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 378us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592796.202838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 108 00000100:00100000:0.0:1788592796.210218:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.210271:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209180416 00000100:00100000:3.0:1788592796.210282:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209180416 00000100:00100000:3.0:1788592796.210343:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 109 00000100:00100000:3.0:1788592796.210354:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:11352:x1875475209180416:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592796.210374:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592796.210405:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db54cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ed9 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.210534:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db54d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.210548:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db54d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.210570:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db54d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592796.210581:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788592796.210690:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db54cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ed9 expref: 42 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.210707:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db54d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ed9 expref: 41 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.210714:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:3.0:1788592796.210717:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592796.210721:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f400, rc 0) 00000100:00100000:3.0:1788592796.210783:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+41:11352:x1875475209180416:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 430us (575us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788592796.210801:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 109 00000100:00100000:2.0:1788592796.215522:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.215569:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.215649:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209180672 00000100:00100000:3.0:1788592796.215660:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209180672 00000100:00100000:1.0:1788592796.215701:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209180800 00000100:00100000:1.0:1788592796.215707:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209180800 00000100:00100000:3.0:1788592796.215721:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 110 00000100:00100000:3.0:1788592796.215733:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:11352:x1875475209180672:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592796.215757:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592796.215780:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db54e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ee0 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592796.215813:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:1.0:1788592796.215823:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+43:2394:x1875475209180800:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592796.215834:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592796.215855:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db54d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ed9 expref: 43 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.215872:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:1.0:1788592796.215877:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592796.215884:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db54e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.215899:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db54e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.215910:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db54e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592796.215921:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788592796.216034:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db54e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee0 expref: 44 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.216050:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db54e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee0 expref: 43 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.216058:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:3.0:1788592796.216061:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788592796.216064:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:1.0:1788592796.216215:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+43:2394:x1875475209180800:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 393us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592796.216223:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:3.0:1788592796.216340:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:11352:x1875475209180672:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 609us (827us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788592796.217211:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 110 00000100:00100000:2.0:1788592796.221270:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.221393:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209180928 00000100:00100000:0.0:1788592796.221402:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209180928 00000100:00100000:0.0:1788592796.221502:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:0.0:1788592796.221513:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209180928:12345-192.168.203.47@tcp:1:lfs.0 00010000:00010000:0.0:1788592796.221557:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.221578:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.221587:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592796.221601:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592796.221621:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.221660:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.221674:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 8 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.221689:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875475226026112:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592796.221816:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592796.225551:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.225700:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209181056 00000100:00100000:3.0:1788592796.225710:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209181056 00002000:00100000:3.0:1788592796.225760:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff921842c49c00 x1875475209181056/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:72/0 lens 504/0 e 0 to 0 dl 1788592807 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592796.225771:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921842c49c00 with x1875475209181056 ext(0->8) 00010000:00010000:3.0:1788592796.225780:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 9 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.225797:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 9 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592796.225805:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff921842c49c00 00000100:00100000:2.0:1788592796.225850:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f611f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875475226026112:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592796.225873:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00010000:00010000:2.0:1788592796.225877:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592796.225882:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2395:x1875475209181056:12345-192.168.203.47@tcp:4:lfs.0 00000100:00100000:3.0:1788592796.227215:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2395:x1875475209181056:12345-192.168.203.47@tcp:4:lfs.0 Request processed in 1327us (1667us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788592796.227228:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00002000:00100000:3.0:1788592796.227237:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff921842c49c00 x1875475209181056/t4294967303(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:72/0 lens 504/448 e 0 to 0 dl 1788592807 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592796.227246:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921842c49c00 with x1875475209181056 ext(0->8) 00010000:00010000:3.0:1788592796.227255:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 11 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.227285:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 11 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592796.227293:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff921842c49c00 00000100:00100000:1.0:1788592796.235387:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.235578:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209181184 00000100:00100000:2.0:1788592796.235598:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209181184 00010000:00010000:2.0:1788592796.235641:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 11 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.235686:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:2.0:1788592796.235696:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2393:x1875475209181184:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592796.235713:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788592796.235730:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788592796.235746:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788592795 00002000:00010000:2.0:1788592796.235748:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788592796 00002000:00010000:2.0:1788592796.235751:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788592795 00002000:00010000:2.0:1788592796.235753:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788592796.235761:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 11 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.235776:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 11 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.235799:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db54b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ecb expref: 11 pid: 8590 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.235816:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592796.235820:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592796.235826:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.235837:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.235877:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592796.236178:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.236235:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2393:x1875475209181184:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 539us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.236244:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00010000:00010000:3.0:1788592796.236315:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236339:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236347:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236354:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236361:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592796.236365:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236373:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236397:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.236404:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a77153b3/0xbd314a3362db54f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592796.236804:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2395:x1875475209180928:12345-192.168.203.47@tcp:1:lfs.0 Request processed in 15291us (15739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592796.236813:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:1.0:1788592796.239155:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.239215:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209181440 00000100:00100000:2.0:1788592796.239226:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209181440 00000100:00100000:2.0:1788592796.239300:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1788592796.239339:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186969bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:11352:x1875475209181440:12345-192.168.203.47@tcp:35:lfs.0 00000004:00010000:2.0:1788592796.239417:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db54e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee0 expref: 42 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592796.239650:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788592796.239684:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788592796.240144:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788592796.240183:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.240198:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 46 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.240208:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.240244:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 46 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.240259:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 46 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.240273:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1875475226026240:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592796.240357:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592796.243939:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743bc9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1875475226026240:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592796.243971:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.244006:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.244149:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209181568 00000100:00100000:0.0:1788592796.244158:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209181568 00010000:00010000:0.0:1788592796.244196:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 47 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.244237:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:0.0:1788592796.244247:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:2396:x1875475209181568:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592796.244262:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592796.244270:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 47 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.244282:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 47 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.244305:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db54a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ebd expref: 47 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.244337:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:0.0:1788592796.244342:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.244352:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.244360:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.244390:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592796.244449:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.244456:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:2396:x1875475209181568:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 209us (449us total) trans 0 rc 0/0 00010000:00010000:1.0:1788592796.244473:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.244476:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00000001:00080000:1.0:1788592796.244606:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788592796.244726:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788592796.244814:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744506d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226026368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788592796.244871:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592796.245470:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592796.245661:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226026368 00000100:00100000:2.0:1788592796.245667:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226026368 00000100:00100000:2.0:1788592796.245753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788592796.245762:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1875475226026368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788592796.245867:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1875475226026368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.245874:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788592796.245932:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744506d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226026368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788592796.246044:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788592796.246132:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744506d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226026496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788592796.246177:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592796.246511:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226026496 00000100:00100000:1.0:1788592796.246514:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592796.246517:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226026496 00000100:00100000:3.0:1788592796.246546:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788592796.246553:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1875475226026496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788592796.246865:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6515:x1875475226026496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 312us (698us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788592796.246873:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788592796.246898:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744506d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1875475226026496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788592796.246942:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788592796.246974:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.246983:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.246991:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.246997:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592796.247001:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.247022:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.247042:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:1.0:1788592796.247045:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788592796.247104:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.247113:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db54fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592796.247233:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788592796.247302:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788592796.247313:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330494245967ns, next at 331494243682ns, rc = 0 00000001:00080000:1.0:1788592796.247319:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788592796.247354:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff921743723200) 00010000:00010000:1.0:1788592796.247357:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788592796.247364:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db54e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee0 expref: 50 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592796.247470:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186969bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:11352:x1875475209181440:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 8134us (8327us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788592796.247477:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000020:00080000:1.0:1788592796.247481:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788592796.251458:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.251542:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209181696 00000100:00100000:0.0:1788592796.251561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209181696 00000100:00100000:0.0:1788592796.251737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 111 00000100:00100000:0.0:1788592796.251750:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:11352:x1875475209181696:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592796.251773:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592796.251795:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ee7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.251854:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee7 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.251870:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee7 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.251967:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592796.251971:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592796.251975:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1e00, rc 0) 00000100:00100000:0.0:1788592796.252287:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+50:11352:x1875475209181696:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 539us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592796.252294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 111 00000100:00100000:0.0:1788592796.257694:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592796.257864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209181952 00000100:00100000:1.0:1788592796.257874:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209181952 00000100:00100000:1.0:1788592796.257933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:1.0:1788592796.257943:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+50:11352:x1875475209181952:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:1.0:1788592796.258222:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:11352:x1875475209181952:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 279us (536us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788592796.258230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:3.0:1788592796.362258:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.362383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209182080 00000100:00100000:0.0:1788592796.362392:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209182080 00000100:00100000:0.0:1788592796.362498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 112 00000100:00100000:0.0:1788592796.362510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:11362:x1875475209182080:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:0.0:1788592796.362611:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362628:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362759:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362776:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362784:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362791:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362968:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362978:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.362985:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592796.363032:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363045:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363052:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363059:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363105:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592796.363110:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363118:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363249:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592796.363253:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592796.363259:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363274:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db550a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363290:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363296:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363302:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363308:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592796.363311:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363317:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363326:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:0.0:1788592796.363328:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592796.363332:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363337:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363347:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363353:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363366:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363371:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592796.363374:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363381:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363389:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592796.363391:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592796.363395:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.363401:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.363475:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:11362:x1875475209182080:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 965us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592796.363484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 112 00000100:00100000:3.0:1788592796.413311:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.416743:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209182336 00000100:00100000:2.0:1788592796.416760:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209182336 00000100:00100000:2.0:1788592796.416863:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 113 00000100:00100000:2.0:1788592796.416874:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:11365:x1875475209182336:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592796.416895:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592796.416915:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db551f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2eee expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418124:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418144:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418157:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418170:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418178:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418185:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418328:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418337:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418344:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592796.418354:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788592796.418430:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418439:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418446:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418451:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592796.418456:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418464:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418475:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592796.418479:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592796.418483:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418501:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db5526 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418514:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418521:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418527:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418531:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592796.418535:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418541:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418549:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:2.0:1788592796.418557:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592796.418572:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418579:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db552d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418629:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db551f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 54 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418656:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 53 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.418664:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592796.418667:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592796.418669:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839a00, rc 0) 00000100:00100000:2.0:1788592796.419655:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:11365:x1875475209182336:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2777us (6347us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788592796.419665:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 113 00000100:00100000:1.0:1788592796.422936:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.423179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209182464 00000100:00100000:0.0:1788592796.423189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209182464 00000100:00100000:0.0:1788592796.423244:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 114 00000100:00100000:0.0:1788592796.423254:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:11365:x1875475209182464:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:0.0:1788592796.423319:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423336:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423357:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423393:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423400:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423407:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423412:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592796.423416:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423423:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423434:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592796.423436:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592796.423441:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.423447:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5542 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.423516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:11365:x1875475209182464:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 262us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592796.423524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 114 00000100:00100000:3.0:1788592796.425681:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592796.425834:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209182720 00000100:00100000:1.0:1788592796.425843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209182720 00000100:00100000:1.0:1788592796.425988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:1.0:1788592796.425998:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+53:11365:x1875475209182720:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:1.0:1788592796.426506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11365:x1875475209182720:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 507us (829us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788592796.426524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1788592796.472597:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226026624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592796.472696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592796.472743:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592796.472750:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226026752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592796.472773:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592796.472802:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226026624 00000100:00100000:3.0:1788592796.472811:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226026624 00000100:00100000:3.0:1788592796.472916:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226026752 00000100:00100000:3.0:1788592796.472921:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226026752 00000100:00100000:2.0:1788592796.473340:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788592796.473354:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226026624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592796.473447:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592796.473557:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226026624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.473565:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788592796.473584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788592796.473600:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226026752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592796.473618:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788592796.473657:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226026752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.473663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788592796.473823:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226026624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592796.473851:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226026752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592796.498891:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592796.499053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209182976 00000100:00100000:0.0:1788592796.499064:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209182976 00000100:00100000:0.0:1788592796.499152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:0.0:1788592796.499169:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11375:x1875475209182976:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592796.499194:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592796.499198:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788592796.499223:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db54c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ed2 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.499242:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:0.0:1788592796.499247:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592796.499260:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5549 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ef5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.499357:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.499372:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 54 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.499380:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.499411:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 54 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592796.499437:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 54 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592796.499452:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921842c4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226026880:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592796.499532:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592796.502218:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592796.502304:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209183104 00000100:00100000:1.0:1788592796.502313:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209183104 00010000:00010000:1.0:1788592796.502349:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 55 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592796.502393:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:1.0:1788592796.502402:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:2396:x1875475209183104:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592796.502416:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592796.502422:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 55 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.502435:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 55 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.502468:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592796.502473:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.502482:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.502490:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.502508:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592796.502608:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:2396:x1875475209183104:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 205us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592796.502615:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 70 00010000:00010000:2.0:1788592796.504142:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5534 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2eee expref: 54 pid: 13208 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.504185:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921842c4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226026880:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592796.504212:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.504222:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.504228:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592796.504247:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788592796.504402:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5549 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.504418:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.504426:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592796.504429:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788592796.504432:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0e00, rc 0) 00000100:00100000:2.0:1788592796.504478:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11375:x1875475209182976:12345-192.168.203.47@tcp:101:bash.0 Request processed in 5309us (5596us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788592796.504486:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:3.0:1788592796.508860:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.508942:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209183232 00000100:00100000:2.0:1788592796.508952:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209183232 00000100:00100000:2.0:1788592796.509036:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:2.0:1788592796.509046:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:11375:x1875475209183232:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592796.509112:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592796.509134:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db555e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2efc expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.509180:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.509195:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.509207:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.509318:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db555e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 56 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.509336:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 55 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.509344:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592796.509348:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592796.509351:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80200, rc 0) 00000100:00100000:2.0:1788592796.509428:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:11375:x1875475209183232:12345-192.168.203.47@tcp:101:bash.0 Request processed in 383us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.509436:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:0.0:1788592796.513282:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592796.513480:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209183488 00000100:00100000:1.0:1788592796.513490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209183488 00000100:00100000:1.0:1788592796.513661:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 117 00000100:00100000:1.0:1788592796.513672:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:11375:x1875475209183488:12345-192.168.203.47@tcp:36:bash.0 00010000:00010000:1.0:1788592796.514040:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.514058:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.514098:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788592796.514143:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788592796.514165:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f4cce9b reply state 000000005f08c897 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.514187:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.514195:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592796.514197:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788592796.514201:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592796.514290:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11375:x1875475209183488:12345-192.168.203.47@tcp:36:bash.0 Request processed in 620us (1015us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788592796.514298:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 117 00000020:00080000:1.0:1788592796.514302:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592796.517219:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.517483:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209183616 00000100:00100000:2.0:1788592796.517495:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209183616 00000100:00100000:2.0:1788592796.517681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 118 00000100:00100000:2.0:1788592796.517693:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11375:x1875475209183616:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592796.517734:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592796.517755:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5573 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f03 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.517846:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.517861:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.517871:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.517904:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.517917:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 59 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.517930:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226027008:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592796.518018:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592796.521738:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226027008:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592796.521769:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592796.521985:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.522061:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209183744 00000100:00100000:3.0:1788592796.522306:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209183744 00010000:00010000:2.0:1788592796.522423:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 60 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.522473:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:2.0:1788592796.522483:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:2393:x1875475209183744:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592796.522503:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592796.522511:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 60 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.522519:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 60 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.522536:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5550 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ef5 expref: 60 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.522546:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592796.522550:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.522558:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.522566:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.522604:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592796.522662:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:2393:x1875475209183744:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 180us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.522670:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 71 00010000:00010000:3.0:1788592796.522766:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.522778:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592796.522831:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788592796.522836:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592796.522855:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.522878:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db5573 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.522888:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.522893:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:3.0:1788592796.522895:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592796.522897:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81c00, rc 0) 00000100:00100000:3.0:1788592796.522918:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11375:x1875475209183616:12345-192.168.203.47@tcp:101:bash.0 Request processed in 5230us (5710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592796.522923:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 118 00000100:00100000:0.0:1788592796.527182:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.527256:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209184000 00000100:00100000:2.0:1788592796.527275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209184000 00000100:00100000:2.0:1788592796.527312:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:2.0:1788592796.527319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:11375:x1875475209184000:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:2.0:1788592796.527543:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11375:x1875475209184000:12345-192.168.203.47@tcp:35:bash.0 Request processed in 213us (359us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788592796.527551:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:1.0:1788592796.582227:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.582291:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209184128 00000100:00100000:3.0:1788592796.582302:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209184128 00000100:00100000:3.0:1788592796.582359:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 119 00000100:00100000:3.0:1788592796.582370:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:11381:x1875475209184128:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592796.582393:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592796.582414:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f0a expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.582679:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5588 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.582694:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.582705:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592796.582751:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788592796.582755:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592796.582774:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.582800:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f0a expref: 61 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.582819:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5588 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f0a expref: 60 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.582828:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592796.582831:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592796.582834:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cbc00, rc 0) 00000100:00100000:3.0:1788592796.582960:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209184128:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 591us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592796.582969:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 119 00000100:00100000:1.0:1788592796.587944:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.588361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209184256 00000100:00100000:3.0:1788592796.588371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209184256 00000100:00100000:3.0:1788592796.588662:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 120 00000100:00100000:3.0:1788592796.588673:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209184256:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592796.588692:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592796.588719:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db558f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588786:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588799:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588808:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588821:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588825:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588888:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588896:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588902:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592796.588958:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788592796.588962:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592796.588982:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.588994:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589002:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589007:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589014:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589019:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cba00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592796.589023:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589030:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589042:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592796.589044:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592796.589049:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589055:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db5596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589316:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589322:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589328:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589333:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592796.589336:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589341:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589349:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:3.0:1788592796.589352:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592796.589355:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589360:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db559d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589387:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db558f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f11 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589400:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f11 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.589418:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:3.0:1788592796.589421:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592796.589424:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:3.0:1788592796.589854:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11381:x1875475209184256:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1182us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592796.589862:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 120 00000100:00100000:0.0:1788592796.593338:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592796.593601:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209184384 00000100:00100000:1.0:1788592796.593611:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209184384 00000100:00100000:1.0:1788592796.593717:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:1.0:1788592796.593728:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:2395:x1875475209184384:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592796.593744:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592796.593768:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db55a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f11 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.593786:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592796.593791:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592796.593848:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:2395:x1875475209184384:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 121us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592796.593856:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:3.0:1788592796.595221:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.595716:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209184640 00000100:00100000:2.0:1788592796.595725:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209184640 00000100:00100000:2.0:1788592796.595781:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:2.0:1788592796.595791:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209184640:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592796.595811:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592796.595830:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db55ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f18 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.595935:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.595951:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.595960:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.595993:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.596005:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 61 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.596039:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226027136:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592796.596335:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592796.598421:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226027136:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592796.598557:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592796.598938:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.599264:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209184768 00000100:00100000:2.0:1788592796.599272:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209184768 00010000:00010000:2.0:1788592796.599304:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 62 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592796.599343:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:2.0:1788592796.599352:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:2396:x1875475209184768:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592796.599365:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592796.599373:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 62 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.599386:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 62 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.599406:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db557a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f03 expref: 62 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.599421:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592796.599426:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.599640:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.599648:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.599676:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592796.599725:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:2396:x1875475209184768:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 373us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.599732:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 72 00010000:00010000:1.0:1788592796.600034:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.600043:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592796.600061:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788592796.600219:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80400/0xbd314a3362db55ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.600234:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592796.600242:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592796.600245:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592796.600247:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838800, rc 0) 00000100:00100000:1.0:1788592796.600278:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11381:x1875475209184640:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 4488us (5062us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788592796.600285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 121 00010000:00010000:3.0:1788592796.602560:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592796.604896:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592796.604948:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185024 00000100:00100000:2.0:1788592796.604958:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185024 00000100:00100000:2.0:1788592796.605022:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:2.0:1788592796.605032:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11381:x1875475209185024:12345-192.168.203.47@tcp:103:lfs.0 00010000:00010000:2.0:1788592796.605057:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592796.605368:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ee7 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592796.605387:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592796.605392:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592796.605448:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209185024:12345-192.168.203.47@tcp:103:lfs.0 Request processed in 417us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.605456:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:2.0:1788592796.608384:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.608453:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185152 00000100:00100000:3.0:1788592796.608464:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185152 00000100:00100000:3.0:1788592796.608522:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:3.0:1788592796.608532:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209185152:12345-192.168.203.47@tcp:58:lfs.0 00010000:00010000:3.0:1788592796.608795:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.608812:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.608824:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592796.609968:0:13208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788592796.610304:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209185152:12345-192.168.203.47@tcp:58:lfs.0 Request processed in 1769us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592796.610329:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:2.0:1788592796.613970:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592796.614476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185280 00000100:00100000:3.0:1788592796.614487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185280 00000100:00100000:3.0:1788592796.614554:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00100000:3.0:1788592796.614649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:11381:x1875475209185280:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592796.614682:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592796.614702:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.615127:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.615142:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.615176:0:6513:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.615191:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.615204:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:3.0:1788592796.615207:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592796.615211:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592796.615219:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca200, rc 0) 00000100:00100000:3.0:1788592796.615278:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11381:x1875475209185280:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 716us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592796.615286:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 123 00000040:00080000:1.0:1788592797.434652:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592797.434661:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592797.434705:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788592797.434714:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592797.434845:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226027264:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592797.434936:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218766770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592797.439769:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226027264:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592797.443684:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.443796:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185408 00000100:00100000:1.0:1788592797.443810:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185408 00000100:00100000:1.0:1788592797.443909:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00100000:1.0:1788592797.443922:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11382:x1875475209185408:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788592797.443956:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788592797.444139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11382:x1875475209185408:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 220us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.444147:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00080000:3.0:1788592797.445741:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592797.449960:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.450261:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185536 00000100:00100000:0.0:1788592797.450274:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185536 00000100:00100000:0.0:1788592797.450356:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 125 00000100:00100000:0.0:1788592797.450369:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11382:x1875475209185536:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788592797.450468:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.450491:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.450507:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.450525:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.450533:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.450564:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452525:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452554:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452566:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592797.452644:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788592797.452649:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592797.452666:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452681:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452688:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452695:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452702:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.452707:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452715:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452746:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:0.0:1788592797.452749:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.452755:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452761:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db55ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452778:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452784:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452789:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452794:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.452798:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452804:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452811:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff92184f8fa400) 00010000:00010000:0.0:1788592797.452814:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.452817:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452822:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db55d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452849:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452855:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452860:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452865:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.452868:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452875:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452882:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592797.452885:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.452888:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.452893:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db55dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.453021:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11382:x1875475209185536:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 Request processed in 2648us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592797.453033:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 125 00000100:00100000:2.0:1788592797.459545:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592797.459806:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185792 00000100:00100000:3.0:1788592797.459819:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185792 00000100:00100000:3.0:1788592797.459908:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 126 00000100:00100000:3.0:1788592797.459920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:11382:x1875475209185792:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592797.459958:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592797.459986:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db55e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460305:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460341:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592797.460353:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788592797.460455:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460463:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460470:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460476:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592797.460481:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460489:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460515:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:3.0:1788592797.460518:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592797.460524:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460531:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db55ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460594:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db55e3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f26 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460605:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:3.0:1788592797.460608:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592797.460613:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db55e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f26 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.460624:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cba00, rc 0) 00000100:00100000:3.0:1788592797.460694:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:11382:x1875475209185792:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 776us (1160us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788592797.460703:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 126 00000100:00100000:2.0:1788592797.466454:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.466621:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209185920 00000100:00100000:0.0:1788592797.466634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209185920 00000100:00100000:0.0:1788592797.466716:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 127 00000100:00100000:0.0:1788592797.466748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:11382:x1875475209185920:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788592797.466800:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788592797.467357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:11382:x1875475209185920:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 608us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592797.467366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 127 00000100:00100000:2.0:1788592797.474227:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.474393:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209186176 00000100:00100000:1.0:1788592797.474406:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209186176 00000100:00100000:1.0:1788592797.474490:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:1.0:1788592797.474504:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:11382:x1875475209186176:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592797.474530:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592797.474534:0:10029:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788592797.474565:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db5588 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f0a expref: 62 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.475526:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:1.0:1788592797.475537:0:10029:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592797.475562:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db55f8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f2d expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592797.476282:0:10029:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788592797.476471:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db55ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.476489:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db55ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.476502:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db55ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.476620:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db55f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f2d expref: 64 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.476640:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db55ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f2d expref: 63 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.476650:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9218765de800) 00010000:00010000:1.0:1788592797.476653:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592797.476657:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b800, rc 0) 00000100:00100000:1.0:1788592797.477348:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:11382:x1875475209186176:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 2844us (3131us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788592797.477360:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:2.0:1788592797.488465:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592797.489837:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209186432 00000100:00100000:3.0:1788592797.489923:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209186432 00000100:00100000:3.0:1788592797.490014:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 129 00000100:00100000:3.0:1788592797.490027:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:11382:x1875475209186432:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788592797.490498:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592797.490535:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db55ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f2d expref: 63 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.490941:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9218765de800) 00010000:00010000:3.0:1788592797.490956:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592797.490986:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491004:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491017:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491421:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491446:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491459:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491540:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491549:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491556:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491562:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cba00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592797.491566:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491605:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491619:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:3.0:1788592797.491632:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592797.491638:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491653:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db560d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491669:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491675:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491680:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491686:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592797.491688:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491694:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491702:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7247d6a4 (ffff921882176a00) 00010000:00010000:3.0:1788592797.491705:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592797.491707:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.491723:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5614 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7247d6a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.491829:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:11382:x1875475209186432:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 1800us (3374us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592797.491839:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 129 00000100:00100000:2.0:1788592797.494717:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.494816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209186560 00000100:00100000:0.0:1788592797.494828:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209186560 00000100:00100000:0.0:1788592797.494920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 130 00000100:00100000:0.0:1788592797.494929:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:11382:x1875475209186560:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592797.494948:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592797.494970:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db561b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f34 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.495003:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.495026:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.495037:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.495195:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db561b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.495214:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.495234:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:0.0:1788592797.495237:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592797.495241:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1600, rc 0) 00000100:00100000:0.0:1788592797.495298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:11382:x1875475209186560:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 369us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592797.495305:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 130 00000100:00100000:2.0:1788592797.498879:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.499023:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209186816 00000100:00100000:1.0:1788592797.499034:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209186816 00000100:00100000:1.0:1788592797.499382:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:1.0:1788592797.499393:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:11382:x1875475209186816:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592797.499496:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.499513:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.499525:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592797.499725:0:10029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1788592797.499735:0:10029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331746667289ns, next at 332746664571ns, rc = 0 00000004:00010000:1.0:1788592797.499793:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017720640 reply state 00000000c0b1f64c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.499806:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.499814:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:1.0:1788592797.499817:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788592797.499821:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592797.499974:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:11382:x1875475209186816:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 582us (1103us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788592797.499981:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:3.0:1788592797.505863:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.506140:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209186944 00000100:00100000:1.0:1788592797.506148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209186944 00000100:00100000:1.0:1788592797.506213:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:1.0:1788592797.506223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:11382:x1875475209186944:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592797.506246:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592797.506270:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f3b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.506338:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.506354:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.506373:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:1.0:1788592797.506376:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592797.506396:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a800, rc 0) 00000100:00100000:1.0:1788592797.506456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:11382:x1875475209186944:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 234us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.506464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:3.0:1788592797.509606:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.513009:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209187072 00000100:00100000:2.0:1788592797.513025:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209187072 00000100:00100000:2.0:1788592797.513153:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:2.0:1788592797.513166:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209187072:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788592797.513386:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209187072:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 222us (3785us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788592797.513394:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00080000:3.0:1788592797.514131:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592797.517178:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.517345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209187328 00000100:00100000:1.0:1788592797.517354:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209187328 00000100:00100000:1.0:1788592797.517411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:1.0:1788592797.517422:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:11382:x1875475209187328:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592797.517664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:11382:x1875475209187328:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 244us (493us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788592797.517672:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:0.0:1788592797.520353:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.520655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209187584 00000100:00100000:2.0:1788592797.520663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209187584 00000100:00100000:2.0:1788592797.520726:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 133 00000100:00100000:2.0:1788592797.520736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:11382:x1875475209187584:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788592797.520912:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:11382:x1875475209187584:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 177us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.520921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 133 00000100:00100000:3.0:1788592797.523291:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.523496:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209187712 00000100:00100000:1.0:1788592797.523504:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209187712 00000100:00100000:1.0:1788592797.523561:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 134 00000100:00100000:1.0:1788592797.523571:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:11382:x1875475209187712:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592797.523599:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592797.523621:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db5637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f42 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.523689:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db563e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.523705:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.523717:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592797.523784:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592797.523802:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db563e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.523827:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db5637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f42 expref: 69 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.523843:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db563e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f42 expref: 68 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.523852:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:1.0:1788592797.523855:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788592797.523859:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a400, rc 0) 00000100:00100000:1.0:1788592797.523971:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:11382:x1875475209187712:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 401us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.523978:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 134 00000100:00100000:3.0:1788592797.527239:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.527369:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209187840 00000100:00100000:2.0:1788592797.527379:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209187840 00000100:00100000:2.0:1788592797.527448:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:2.0:1788592797.527459:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209187840:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592797.527475:0:8590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592797.527496:0:8590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f49 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592797.527521:0:8590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc29d, blocks: 0x0 00010000:00010000:2.0:1788592797.527540:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1788592797.527545:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592797.527554:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 10 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.527573:0:8590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 10 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.527593:0:8590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f800, rc 0) 00000100:00100000:2.0:1788592797.527682:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2396:x1875475209187840:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 223us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.527690:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:0.0:1788592797.530326:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.530590:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188096 00000100:00100000:1.0:1788592797.530600:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188096 00000100:00100000:1.0:1788592797.530657:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 135 00000100:00100000:1.0:1788592797.530666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:11382:x1875475209188096:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788592797.530774:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:11382:x1875475209188096:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 108us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.530782:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 135 00000100:00100000:2.0:1788592797.533855:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592797.533930:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188224 00000100:00100000:3.0:1788592797.533939:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188224 00000100:00100000:3.0:1788592797.533990:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:3.0:1788592797.533999:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:11382:x1875475209188224:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592797.534015:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592797.534031:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f50 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.534100:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.534109:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592797.534112:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592797.534118:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.534365:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.534393:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.534408:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174449e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875475226027392:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592797.534494:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592797.537176:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.537296:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174449e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875475226027392:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592797.537330:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.537350:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca600, rc 0) 00000100:00100000:1.0:1788592797.537410:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:11382:x1875475209188224:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 3413us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.537417:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:3.0:1788592797.537586:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188352 00000100:00100000:3.0:1788592797.537593:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188352 00010000:00010000:3.0:1788592797.537624:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.537655:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:3.0:1788592797.537664:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2396:x1875475209188352:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592797.537676:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592797.537698:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.537708:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.537725:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db6b3244/0xbd314a3362db5645 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f49 expref: 11 pid: 8590 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.537735:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592797.537738:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592797.537744:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.537751:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.537790:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.537801:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174449f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10331:1875475226027520:192.168.203.47@tcp:105: 00000100:00100000:3.0:1788592797.537841:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217429c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592797.541291:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.541351:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188480 00000100:00100000:1.0:1788592797.541359:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188480 00000100:00100000:3.0:1788592797.541362:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174449f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10331:1875475226027520:192.168.203.47@tcp:105: 00010000:00010000:3.0:1788592797.541384:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592797.541431:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2396:x1875475209188352:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3769us (4264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592797.541439:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 73 00002000:00100000:1.0:1788592797.541616:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff921842c49880 x1875475209188480/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:73/0 lens 504/0 e 0 to 0 dl 1788592808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592797.541628:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921842c49880 with x1875475209188480 ext(0->12) 00002000:00010000:1.0:1788592797.541633:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921842c49880 00000100:00100000:1.0:1788592797.541666:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:1.0:1788592797.541677:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2396:x1875475209188480:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788592797.542840:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:2396:x1875475209188480:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 Request processed in 1160us (1552us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788592797.542861:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00002000:00100000:1.0:1788592797.542870:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff921842c49880 x1875475209188480/t4294967309(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:73/0 lens 504/448 e 0 to 0 dl 1788592808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592797.542879:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921842c49880 with x1875475209188480 ext(0->12) 00002000:00010000:1.0:1788592797.542885:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921842c49880 00000100:00100000:0.0:1788592797.545144:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.545243:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188608 00000100:00100000:2.0:1788592797.545253:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188608 00000100:00100000:2.0:1788592797.545312:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 136 00000100:00100000:2.0:1788592797.545324:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:11382:x1875475209188608:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788592797.547006:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788592797.547016:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788592797.547045:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788592797.547047:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:0.0:1788592797.547060:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547108:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547115:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.547120:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547127:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547143:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff92184f8fa500) 00010000:00010000:0.0:1788592797.547145:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.547164:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547173:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db5351 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.547185:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226027648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788592797.547186:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592797.547198:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226027904:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788592797.547199:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547207:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547212:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547215:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.547218:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547222:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547228:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff92184f8faa00) 00010000:00010000:0.0:1788592797.547230:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.547232:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547236:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db53f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.547245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592797.547249:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.547250:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226027776:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788592797.547260:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547269:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547273:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.547276:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547280:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547289:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00000100:00100000:2.0:1788592797.547291:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226027904 00000100:00100000:1.0:1788592797.547294:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592797.547295:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592797.547297:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226027904 00010000:00010000:0.0:1788592797.547310:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547318:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5477 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.547329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592797.547337:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226027776 00000100:00100000:2.0:1788592797.547341:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226027776 00010000:00010000:0.0:1788592797.547342:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547349:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547356:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.547360:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226027648 00010000:00010000:0.0:1788592797.547363:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839400 already unused, calling callback (ffffffffc19d04f0) 00000100:00100000:2.0:1788592797.547364:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226027648 00000100:00100000:1.0:1788592797.547368:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1788592797.547370:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.547378:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788592797.547378:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3640:x1875475226027904:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788592797.547384:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875475226027776:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:1.0:1788592797.547400:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1788592797.547408:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547419:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff921882176700) 00010000:00010000:0.0:1788592797.547422:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.547425:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592797.547430:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bc29b, atime: 0x6a9bc29c, ctime: 0x6a9bc29b, blocks: 0x8 00010000:00010000:0.0:1788592797.547432:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db549a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547439:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547456:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788592797.547457:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547463:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592797.547468:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788592797.547472:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9218430c30c0 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:1.0:1788592797.547472:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547477:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788592797.547478:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921743758900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9218430c3180 00000020:00080000:3.0:1788592797.547485:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921743758200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92187c88f200 00010000:00010000:0.0:1788592797.547493:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592797.547494:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547500:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547510:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547522:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547532:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547533:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00000020:00080000:3.0:1788592797.547536:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff921741d22840 refcount 2 committed 0 result 0 batchid 2 00010000:00010000:0.0:1788592797.547540:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1788592797.547541:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921844d4a000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff921741d22240 00000020:00080000:3.0:1788592797.547545:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921844d4a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92187d773200 00010000:00010000:1.0:1788592797.547551:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788592797.547556:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788592797.547570:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:0.0:1788592797.547602:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547620:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db556c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788592797.547624:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1788592797.547636:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547654:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547660:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547665:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.547668:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547675:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547684:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:0.0:1788592797.547686:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592797.547689:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547694:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5629 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.547699:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3640:x1875475226027904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 321us (453us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788592797.547710:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788592797.547725:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592797.547737:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3641:x1875475226027648:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788592797.547739:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592797.547745:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592797.547750:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00080000:0.0:1788592797.547753:0:10091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788592797.547754:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788592797 00010000:00010000:1.0:1788592797.547754:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b800 already unused, calling callback (ffffffffc0dc24f0) 00002000:00010000:2.0:1788592797.547757:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1788592797.547758:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592797.547760:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788592797 -> 1788592797 00002000:00010000:2.0:1788592797.547764:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788592797.547769:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547775:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547782:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547791:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db5653 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.547793:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.547799:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3642:x1875475226027776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 413us (506us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788592797.547812:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1788592797.547816:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788592797.547821:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592797.547825:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592797.547825:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.547829:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592797.547831:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788592797.547855:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921875ab8700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788592797.547860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226027776:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788592797.547870:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788592797.547873:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592797.547878:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788592797.547891:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 11 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.547903:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921842c49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10091:1875475226028032:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592797.547976:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855000 going to sleep for 11 seconds 00000004:00080000:3.0:1788592797.547998:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92186d50b480/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788592797.548010:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226027904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788592797.548051:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11382:x1875475209188608:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 Request processed in 2729us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.548060:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 136 00000100:00100000:2.0:1788592797.550389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.550415:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921842c49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10091:1875475226028032:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592797.550442:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.551673:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.551822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188736 00000100:00100000:1.0:1788592797.551830:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188736 00010000:00010000:1.0:1788592797.551866:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 12 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.551911:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 74 00000100:00100000:1.0:1788592797.551922:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:2395:x1875475209188736:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592797.551936:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592797.551942:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 12 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.551956:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 12 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.551978:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db5407 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ea8 expref: 12 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.551994:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592797.551998:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592797.552004:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.552029:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.552054:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592797.552120:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2395:x1875475209188736:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 200us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.552128:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 74 00010000:00010000:0.0:1788592797.552445:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.552468:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.552479:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.552487:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.552511:0:10091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788592797.552683:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3641:x1875475226027648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4949us (5353us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788592797.552691:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592797.552704:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209188864 00000100:00100000:0.0:1788592797.552708:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209188864 00010000:00010000:3.0:1788592797.552755:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592797.552763:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.552774:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592797.552779:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.552788:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.552802:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.552810:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000126192b/0xbd314a3362db565a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.552827:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592797.552829:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592797.552831:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788592797.553042:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff921743992300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788592797.553049:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226027648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788592797.553122:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:2.0:1788592797.553132:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2396:x1875475209188864:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788592797.554985:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788592797.555000:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788592797.555381:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209188864:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 Request processed in 2246us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.555391:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:3.0:1788592797.558775:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.560248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209189120 00000100:00100000:2.0:1788592797.560263:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209189120 00000100:00100000:2.0:1788592797.560334:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 137 00000100:00100000:2.0:1788592797.560353:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11382:x1875475209189120:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592797.560480:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592797.560507:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db563e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f42 expref: 16 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.560528:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:2.0:1788592797.560533:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592797.560653:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.560668:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.560679:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592797.560807:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc5ae433 reply state 0000000023d437fe transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.560819:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.560843:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:2.0:1788592797.560845:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592797.560848:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592797.560968:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:11382:x1875475209189120:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 625us (2201us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788592797.560976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 137 00000100:00100000:2.0:1788592797.563976:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.564135:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209189248 00000100:00100000:1.0:1788592797.564144:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209189248 00000100:00100000:1.0:1788592797.564291:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:1.0:1788592797.564302:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209189248:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788592797.564527:0:8590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788592797.564531:0:8590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788592797 -> 1788592796 00002000:00010000:1.0:1788592797.564534:0:8590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788592796 00002000:00010000:1.0:1788592797.564536:0:8590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788592797 -> 1788592796 00002000:00010000:1.0:1788592797.564538:0:8590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788592797.564840:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209189248:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 538us (935us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788592797.564848:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:1.0:1788592797.568709:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.568775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209189504 00000100:00100000:2.0:1788592797.568783:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209189504 00000100:00100000:2.0:1788592797.568907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 138 00000100:00100000:2.0:1788592797.568918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:11382:x1875475209189504:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788592797.568986:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.569003:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.569013:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.569052:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.569091:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 17 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.569103:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226028160:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592797.569172:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592797.570966:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226028160:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592797.571002:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.571313:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.571387:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209189632 00000100:00100000:0.0:1788592797.571394:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209189632 00010000:00010000:0.0:1788592797.571424:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 18 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.571457:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 75 00000100:00100000:0.0:1788592797.571465:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:2395:x1875475209189632:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592797.571475:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592797.571480:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 18 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.571501:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 18 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.571517:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f34 expref: 18 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.571527:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:0.0:1788592797.571530:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.571537:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.571545:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.571575:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592797.571634:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:2395:x1875475209189632:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 169us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592797.571642:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 75 00010000:00010000:2.0:1788592797.571684:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571692:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571731:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571738:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571744:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571750:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ec00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592797.571754:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571772:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571782:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:2.0:1788592797.571785:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788592797.571919:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.571942:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db5668 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.571994:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11382:x1875475209189504:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 Request processed in 3078us (3291us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788592797.572003:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 138 00000100:00100000:3.0:1788592797.573786:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.573865:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209189760 00000100:00100000:2.0:1788592797.573873:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209189760 00000100:00100000:2.0:1788592797.573934:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:2.0:1788592797.573943:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209189760:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788592797.574054:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.574096:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.574106:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592797.574110:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592797.574115:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.574147:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.574166:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 7 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.574189:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875475226028288:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592797.574245:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592797.577460:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875475226028288:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592797.577489:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.578320:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592797.578429:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209189888 00000100:00100000:1.0:1788592797.578437:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209189888 00010000:00010000:1.0:1788592797.578472:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 8 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.578610:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:1.0:1788592797.578622:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209189888:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592797.578637:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592797.578659:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 8 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.578673:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 8 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.578695:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069052dc7/0xbd314a3362db564c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f50 expref: 8 pid: 8428 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.578712:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592797.578717:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592797.578723:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.578734:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.578767:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592797.578876:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209189888:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 255us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592797.578884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 76 00010000:00010000:2.0:1788592797.578924:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.578937:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.578969:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.578979:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.578988:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.578995:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592797.578999:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.579456:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.579488:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.579497:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084502373/0xbd314a3362db566f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.579576:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209189760:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 Request processed in 5626us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.579595:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:2.0:1788592797.581436:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.581701:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209190144 00000100:00100000:0.0:1788592797.581711:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209190144 00000100:00100000:0.0:1788592797.581799:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 139 00000100:00100000:0.0:1788592797.581811:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:11382:x1875475209190144:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788592797.582383:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.582402:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 16 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.582427:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.582461:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 16 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.582475:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 16 pid: 13208 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.582489:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921842c49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226028416:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592797.582767:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592797.585504:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921842c49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226028416:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592797.585535:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.586602:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592797.587035:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209190272 00000100:00100000:3.0:1788592797.587385:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209190272 00010000:00010000:0.0:1788592797.587504:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 17 pid: 13208 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.587578:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:0.0:1788592797.587597:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:2395:x1875475209190272:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592797.587612:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592797.587619:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 17 pid: 13208 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587634:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 17 pid: 13208 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587655:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db5565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2efc expref: 17 pid: 13208 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587684:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592797.587691:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587701:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587709:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587717:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.587789:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592797.587845:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:2395:x1875475209190272:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 247us (1243us total) trans 0 rc 0/0 00010000:00010000:2.0:1788592797.587851:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.587853:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 77 00010000:00010000:2.0:1788592797.587859:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.588027:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.588055:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.588100:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.588246:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.588260:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 16 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.588272:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226028544:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592797.588341:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592797.590104:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226028544:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592797.590131:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592797.590662:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592797.590831:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209190400 00000100:00100000:3.0:1788592797.590838:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209190400 00010000:00010000:3.0:1788592797.590870:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 17 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.591044:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 78 00000100:00100000:3.0:1788592797.591054:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:2396:x1875475209190400:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592797.591090:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592797.591098:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 17 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.591111:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 17 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.591133:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f3b expref: 17 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.591148:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:3.0:1788592797.591153:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.591161:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.591168:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592797.591190:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592797.591243:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+16:2396:x1875475209190400:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 189us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592797.591264:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 78 00010000:00010000:0.0:1788592797.591297:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.591309:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592797.591425:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788592797.591686:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788592797.591825:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788592797.591902:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921842c48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226028672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788592797.591962:0:13208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592797.592001:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592797.592059:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226028672 00000100:00100000:2.0:1788592797.592104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226028672 00000100:00100000:2.0:1788592797.592160:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788592797.592168:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13208:x1875475226028672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788592797.592246:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13208:x1875475226028672:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.592253:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788592797.592333:0:13208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788592797.592347:0:13208:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1788592797.592370:0:13208:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff921875ab8700, transno 4294967310 00000004:00080000:0.0:1788592797.592388:0:13208:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff921743992300, transno 4294967311 00000100:00100000:0.0:1788592797.592395:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921842c48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226028672:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788592797.592530:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788592797.592576:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921842c48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226028800:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788592797.592614:0:13208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592797.592643:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855000 going to sleep for 11 seconds 00000100:00100000:3.0:1788592797.592647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226028800 00000100:00100000:3.0:1788592797.592654:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226028800 00000100:00100000:3.0:1788592797.592693:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788592797.592700:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13208:x1875475226028800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788592797.592859:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13208:x1875475226028800:12345-0@lo:1000:mdt00_004.0 Request processed in 159us (244us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788592797.592868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788592797.592991:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921842c48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226028800:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788592797.593023:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593033:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593042:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593048:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ec00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.593053:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593063:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593205:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:0.0:1788592797.593209:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592797.593214:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593222:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db567d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593245:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593251:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593257:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593262:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.593265:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593272:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593280:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592797.593283:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592797.593289:0:13208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593300:0:13208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593388:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.593417:0:13208:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.593428:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921842c48000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226028928:192.168.203.47@tcp:105: 00000100:00100000:0.0:1788592797.593536:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592797.595539:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.595682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209190528 00000100:00100000:2.0:1788592797.595691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209190528 00000100:00100000:0.0:1788592797.595709:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921842c48000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226028928:192.168.203.47@tcp:105: 00010000:00010000:0.0:1788592797.595737:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.595746:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00010000:00010000:0.0:1788592797.595750:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db55c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.595759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11381:x1875475209190528:12345-192.168.203.47@tcp:49:lfs.0 00010000:00010000:0.0:1788592797.595787:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595801:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595812:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595821:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595827:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595853:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595860:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.595864:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595871:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595882:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592797.595885:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592797.595889:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595895:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5684 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595905:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595912:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595918:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595924:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592797.595927:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.595945:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:11381:x1875475209190528:12345-192.168.203.47@tcp:49:lfs.0 Request processed in 187us (412us total) trans 0 rc 0/0 00010000:00010000:0.0:1788592797.595945:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.595955:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592797.595961:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592797.595964:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.595967:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00010000:00010000:0.0:1788592797.595974:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db5676 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.596163:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:11382:x1875475209190144:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 14353us (14733us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788592797.596174:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 139 00000020:00080000:0.0:1788592797.596177:0:13208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788592797.596237:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592797.596242:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592797.597423:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788592797.597436:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592797.601500:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.601652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209190784 00000100:00100000:2.0:1788592797.601661:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209190784 00000100:00100000:2.0:1788592797.601719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:2.0:1788592797.601733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921869698c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:11382:x1875475209190784:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788592797.602165:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788592797.602202:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788592797.602240:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.602268:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.602281:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.602289:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.602295:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.602302:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.602326:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592797.602381:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592797.602389:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.602398:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592797.602403:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.602411:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592797.602424:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00000100:00100000:2.0:1788592797.602428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921869698c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:11382:x1875475209190784:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 697us (934us total) trans 4294967410 rc 0/0 00010000:00010000:1.0:1788592797.602430:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788592797.602436:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.602442:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 32 00010000:00010000:1.0:1788592797.602447:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db568b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788592797.602450:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788592797.602464:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592797.602467:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592797.602469:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592797.602897:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.603166:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209191040 00000100:00100000:2.0:1788592797.603172:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209191040 00000100:00100000:2.0:1788592797.603206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:2.0:1788592797.603214:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:11381:x1875475209191040:12345-192.168.203.47@tcp:58:lfs.0 00000040:00080000:2.0:1788592797.603338:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788592797.603436:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:11381:x1875475209191040:12345-192.168.203.47@tcp:58:lfs.0 Request processed in 222us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.603443:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:0.0:1788592797.620981:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592797.621130:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209191168 00000100:00100000:2.0:1788592797.621139:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209191168 00000100:00100000:2.0:1788592797.621204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 141 00000100:00100000:2.0:1788592797.621212:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:11384:x1875475209191168:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592797.621232:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592797.621249:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f57 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621299:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621312:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621323:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621356:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621363:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621369:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621444:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621454:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621462:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621493:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.621506:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 22 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592797.621519:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226029056:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592797.621646:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d220c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788592797.624608:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592797.624697:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.624818:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209191424 00000100:00100000:0.0:1788592797.624826:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209191424 00000100:00100000:0.0:1788592797.624883:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:0.0:1788592797.624894:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:6631:x1875475209191424:12345-192.168.203.47@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788592797.625151:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:6631:x1875475209191424:12345-192.168.203.47@tcp:35:ldlm_bl.0 Request processed in 257us (457us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788592797.625159:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:2.0:1788592797.625283:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226029056:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592797.625309:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592797.628968:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592797.629311:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209191552 00000100:00100000:0.0:1788592797.629446:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209191552 00010000:00010000:0.0:1788592797.629488:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592797.629555:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:0.0:1788592797.629566:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:2396:x1875475209191552:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592797.629594:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592797.629603:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.629617:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.629640:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838800/0xbd314a3362db55b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f18 expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.629655:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:0.0:1788592797.629661:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.629670:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.629679:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592797.629784:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592797.629847:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:2396:x1875475209191552:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 282us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592797.629856:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 79 00010000:00010000:2.0:1788592797.630218:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630227:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592797.630279:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788592797.630284:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592797.630303:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630316:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630325:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630332:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630338:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630343:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592797.630347:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630354:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630364:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:2.0:1788592797.630376:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592797.630381:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630387:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5699 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630399:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630404:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630409:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630414:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592797.630417:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630422:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630429:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff92174372d400) 00010000:00010000:2.0:1788592797.630432:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592797.630434:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630439:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db56a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630474:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f57 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630498:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f57 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592797.630504:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:2.0:1788592797.630506:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592797.630509:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e400, rc 0) 00000100:00100000:2.0:1788592797.630539:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11384:x1875475209191168:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 9328us (9567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592797.630547:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 141 00000040:00080000:2.0:1788592798.201037:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788592798.225011:0:14247:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592798.225024:0:14247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592798.225062:0:14247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788592798.225134:0:14247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592798.520607:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592798.520733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592798.520818:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029184 00000100:00100000:1.0:1788592798.520828:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029184 00000100:00100000:3.0:1788592798.520973:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788592798.520985:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226029184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592798.521006:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788592798.521055:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226029184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.521090:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788592798.521242:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592798.523850:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226029312:0@lo:400:kworker.0 00000100:00100000:2.0:1788592798.523930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592798.523969:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226029440:0@lo:400:kworker.0 00000100:00100000:2.0:1788592798.523976:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226029824:0@lo:400:kworker.0 00000100:00100000:0.0:1788592798.524057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592798.524120:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226029952:0@lo:400:kworker.0 00000100:00100000:2.0:1788592798.524131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029312 00000100:00100000:2.0:1788592798.524140:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029312 00000100:00100000:0.0:1788592798.524527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592798.524596:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788592798.524600:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029440 00000100:00100000:1.0:1788592798.524605:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029440 00000100:00100000:2.0:1788592798.524617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226029312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592798.524634:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029952 00000100:00100000:1.0:1788592798.524637:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029952 00000100:00100000:1.0:1788592798.524660:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788592798.524667:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226029312:12345-0@lo:400:kworker.0 Request processed in 62us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592798.524667:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226029440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592798.524675:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788592798.524707:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788592798.524715:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226029952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592798.524744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226029952:12345-0@lo:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592798.524766:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788592798.524809:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226029696:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.524865:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.524901:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226030208:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.524927:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.524956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226030720:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.524980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.525014:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788592798.525021:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226029568:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.525062:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226030080:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525101:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.525119:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226030592:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.525161:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029696 00000100:00100000:3.0:1788592798.525165:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029696 00000100:00100000:3.0:1788592798.525192:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029568 00000100:00100000:3.0:1788592798.525195:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029568 00000100:00100000:3.0:1788592798.525209:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788592798.525215:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226029696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525256:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226029696:12345-0@lo:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.525262:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788592798.525276:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788592798.525282:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226029568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592798.525304:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226030464:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525313:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226029568:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.525332:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788592798.525343:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.525370:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030208 00000100:00100000:3.0:1788592798.525376:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030208 00000100:00100000:0.0:1788592798.525383:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226029952:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525411:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030720 00000100:00100000:0.0:1788592798.525416:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030080 00000100:00100000:3.0:1788592798.525421:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030720 00000100:00100000:0.0:1788592798.525422:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030080 00000100:00100000:3.0:1788592798.525460:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788592798.525480:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226030208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592798.525508:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226029440:12345-0@lo:400:kworker.0 Request processed in 840us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592798.525518:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788592798.525524:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226030208:12345-0@lo:400:kworker.0 Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.525537:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788592798.525553:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788592798.525559:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226030720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525600:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226030720:12345-0@lo:400:kworker.0 Request processed in 41us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.525606:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788592798.525658:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226029568:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525669:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226029696:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525678:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226030208:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.525686:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226030720:0@lo:400:kworker.0 00000100:00080000:3.0:1788592798.525736:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592798.525741:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592798.525743:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592798.525745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592798.525899:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592798.525920:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226030336:0@lo:400:kworker.0 00000100:00100000:0.0:1788592798.525921:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030592 00000100:00100000:0.0:1788592798.525928:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030592 00000100:00100000:3.0:1788592798.525953:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592798.525961:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030464 00000100:00100000:0.0:1788592798.525966:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030464 00000100:00100000:0.0:1788592798.525984:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226029824 00000100:00100000:0.0:1788592798.525987:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226029824 00000100:00100000:3.0:1788592798.525989:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226029312:0@lo:400:kworker.0 00000100:00100000:0.0:1788592798.526006:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788592798.526014:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226030080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.526033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788592798.526044:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226030592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592798.526058:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226030080:12345-0@lo:400:kworker.0 Request processed in 43us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592798.526086:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788592798.526101:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788592798.526109:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.526118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226030592:12345-0@lo:400:kworker.0 Request processed in 77us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.526127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788592798.526147:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226030464:12345-0@lo:400:kworker.0 Request processed in 39us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.526150:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788592798.526158:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226029824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.526191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226029824:12345-0@lo:400:kworker.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.526197:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788592798.526217:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030336 00000100:00100000:3.0:1788592798.526220:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030336 00000100:00100000:3.0:1788592798.526246:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788592798.526252:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3641:x1875475226030336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592798.526266:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226029440:0@lo:400:kworker.0 00000100:00100000:1.0:1788592798.526281:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226030464:0@lo:400:kworker.0 00000100:00100000:3.0:1788592798.526287:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3641:x1875475226030336:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.526295:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788592798.526322:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788592798.526334:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226029824:0@lo:400:kworker.0 00000100:00080000:1.0:1788592798.526349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592798.526350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226030336:0@lo:400:kworker.0 00000100:00080000:1.0:1788592798.526356:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788592798.526369:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f484e00 x1875475226030080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592798.526382:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226030080:0@lo:400:kworker.0 00010000:00080000:0.0:1788592798.526393:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f530a80 x1875475226030592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592798.526402:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226030592:0@lo:400:kworker.0 00000040:00080000:1.0:1788592798.648682:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592798.648691:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592798.648717:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788592798.648726:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592798.648866:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744526d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226030848:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592798.648962:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff921858657780 going to sleep for 11 seconds 00010000:00010000:3.0:1788592798.649105:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592798.651616:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744526d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226030848:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592798.654961:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592798.655232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209191680 00000100:00100000:3.0:1788592798.655241:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209191680 00000100:00100000:3.0:1788592798.655318:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:3.0:1788592798.655374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11396:x1875475209191680:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592798.655411:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592798.655581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11396:x1875475209191680:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 247us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.655609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:3.0:1788592798.662798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592798.663200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209191936 00000100:00100000:1.0:1788592798.663210:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209191936 00000100:00100000:1.0:1788592798.663271:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 143 00000100:00100000:1.0:1788592798.663281:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:11396:x1875475209191936:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592798.663301:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592798.663345:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f5e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.663452:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db56b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.663478:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db56b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.664407:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db56b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592798.664425:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788592798.664680:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f5e expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.664700:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db56b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f5e expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.664708:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592798.664711:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592798.664714:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b000, rc 0) 00000100:00100000:1.0:1788592798.664788:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:11396:x1875475209191936:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 1509us (1999us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788592798.664797:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 143 00000100:00100000:0.0:1788592798.670951:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592798.671539:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209192064 00000100:00100000:3.0:1788592798.671563:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209192064 00000100:00100000:3.0:1788592798.671634:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:3.0:1788592798.671644:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:2393:x1875475209192064:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592798.671661:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592798.671685:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db56b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f5e expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592798.671704:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:3.0:1788592798.671710:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592798.672126:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:2393:x1875475209192064:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 482us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592798.672136:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:2.0:1788592798.672407:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592798.672520:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209192320 00000100:00100000:1.0:1788592798.672525:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209192320 00000100:00100000:1.0:1788592798.672588:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 144 00000100:00100000:1.0:1788592798.672596:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:11396:x1875475209192320:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788592798.672672:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672687:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672698:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672847:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672856:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672862:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672867:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592798.672871:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672878:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672889:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592798.672892:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592798.672896:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592798.672901:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592798.673017:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:11396:x1875475209192320:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 421us (611us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788592798.673026:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 144 00000040:00080000:3.0:1788592798.673280:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592798.673286:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592798.673758:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788592798.673766:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592798.676861:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592798.676929:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209192576 00000100:00100000:1.0:1788592798.676939:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209192576 00000100:00100000:1.0:1788592798.676992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:1.0:1788592798.677002:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:11396:x1875475209192576:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592798.677263:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:11396:x1875475209192576:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 261us (410us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788592798.677271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:1.0:1788592799.032580:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592799.032606:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174449e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226030976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592799.032675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592799.035144:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226030976 00000100:00100000:3.0:1788592799.035155:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226030976 00000100:00100000:3.0:1788592799.035221:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788592799.035233:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226030976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592799.035263:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788592799.035435:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226030976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 204us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592799.035458:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788592799.035593:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174449e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226030976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592799.544212:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592799.544232:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226031104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592799.544324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592799.544365:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031104 00000100:00100000:1.0:1788592799.544372:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031104 00000100:00100000:1.0:1788592799.544431:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788592799.544440:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3641:x1875475226031104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592799.544469:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592799.544524:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3641:x1875475226031104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592799.544540:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1788592799.544560:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592799.544604:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226031104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592799.545371:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592799.545383:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226031232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592799.545421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592799.545466:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031232 00000100:00100000:2.0:1788592799.545471:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031232 00000100:00100000:2.0:1788592799.545497:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592799.545505:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226031232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788592799.545517:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788592799.545549:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226031232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592799.545555:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592799.545679:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226031232:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788592799.549284:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788592799.549299:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:1.0:1788592799.672604:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592799.782884:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592799.782895:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592799.782924:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788592799.782931:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592799.893188:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592799.893233:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209192832 00000100:00100000:3.0:1788592799.893243:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209192832 00000100:00080000:1.0:1788592799.893317:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592799.893323:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 145 00000100:00100000:3.0:1788592799.893335:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:11417:x1875475209192832:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592799.893588:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592799.893611:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db56ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f65 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.893771:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db56d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.893787:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db56d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.893802:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db56d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592799.893814:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788592799.893914:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cba00/0xbd314a3362db56ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f65 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.893935:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db56d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f65 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.893943:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:3.0:1788592799.893960:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788592799.893963:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cbc00, rc 0) 00000100:00100000:3.0:1788592799.894033:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:11417:x1875475209192832:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 700us (862us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788592799.894040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 145 00000100:00100000:3.0:1788592799.896967:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592799.897246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209192960 00000100:00100000:1.0:1788592799.897254:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209192960 00000100:00100000:1.0:1788592799.897319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 146 00000100:00100000:1.0:1788592799.897329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:11417:x1875475209192960:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:1.0:1788592799.897389:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897405:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897415:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897449:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897457:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897464:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897470:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592799.897474:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897495:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897508:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592799.897511:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592799.897515:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592799.897521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db56df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592799.897660:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:11417:x1875475209192960:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 333us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592799.897668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 146 00000100:00100000:0.0:1788592799.965950:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592799.966151:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193088 00000100:00100000:3.0:1788592799.966160:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193088 00000100:00100000:3.0:1788592799.966231:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:3.0:1788592799.966241:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209193088:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:3.0:1788592799.966259:0:8590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592799.966279:0:8590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a08bef1/0xbd314a3362db56e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f6c expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592799.966303:0:8590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bc29c, atime: 0x6a9bc29c, ctime: 0x6a9bc29c, blocks: 0x8 00010000:00010000:3.0:1788592799.966322:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788592799.966327:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592799.966336:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a08bef1/0xbd314a3362db56e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f6c expref: 7 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.966355:0:8590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a08bef1/0xbd314a3362db56e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f6c expref: 7 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788592799.966358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788592799.966368:0:8590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cba00, rc 0) 00000100:00100000:3.0:1788592799.966472:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209193088:12345-192.168.203.47@tcp:101:cat.0 Request processed in 232us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592799.966494:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:0.0:1788592799.970798:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592799.970887:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193216 00000100:00100000:3.0:1788592799.970897:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193216 00002000:00100000:3.0:1788592799.970945:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff921842c4ad80 x1875475209193216/t0(0) o3->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:75/0 lens 488/0 e 0 to 0 dl 1788592810 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592799.970957:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921842c4ad80 with x1875475209193216 ext(0->4095) 00002000:00010000:3.0:1788592799.970962:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921842c4ad80 00000100:00100000:3.0:1788592799.970993:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:3.0:1788592799.971003:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209193216:12345-192.168.203.47@tcp:3:cat.0 00000100:00100000:3.0:1788592799.971863:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209193216:12345-192.168.203.47@tcp:3:cat.0 Request processed in 858us (1071us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788592799.971872:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00002000:00100000:3.0:1788592799.971880:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff921842c4ad80 x1875475209193216/t0(0) o3->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:75/0 lens 488/4536 e 0 to 0 dl 1788592810 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592799.971889:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921842c4ad80 with x1875475209193216 ext(0->4095) 00002000:00010000:3.0:1788592799.971894:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921842c4ad80 00010000:00010000:0.0:1788592800.696871:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592800.703043:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592800.703259:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592800.703297:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592800.703331:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592800.703355:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592800.703375:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592800.703400:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193856 00000100:00100000:2.0:1788592800.703402:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592800.703413:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193856 00000100:00100000:2.0:1788592800.703427:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193600 00000100:00100000:2.0:1788592800.703430:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193600 00000100:00100000:3.0:1788592800.703469:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193728 00000100:00100000:3.0:1788592800.703472:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193728 00000100:00100000:3.0:1788592800.703500:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:3.0:1788592800.703512:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2394:x1875475209193856:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592800.703615:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2394:x1875475209193856:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592800.703664:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193472 00000100:00100000:1.0:1788592800.703669:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193472 00000100:00100000:1.0:1788592800.703692:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193984 00000100:00100000:1.0:1788592800.703694:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193984 00000100:00100000:1.0:1788592800.703710:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209194112 00000100:00100000:1.0:1788592800.703713:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209194112 00000100:00100000:1.0:1788592800.703729:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 250 00000100:00100000:1.0:1788592800.703736:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209193600:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592800.703771:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209193600:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592800.703779:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 250 00000100:00100000:1.0:1788592800.703798:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 251 00000100:00100000:1.0:1788592800.703805:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:2393:x1875475209193472:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592800.703847:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:2393:x1875475209193472:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 41us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592800.703853:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 251 00000100:00100000:1.0:1788592800.703868:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 252 00000100:00100000:1.0:1788592800.703875:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209193984:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592800.703901:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209193984:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592800.703907:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 252 00000100:00100000:1.0:1788592800.703919:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 253 00000100:00100000:1.0:1788592800.703925:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209194112:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592800.703970:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209194112:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 45us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592800.703977:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 253 00000100:00080000:1.0:1788592800.703998:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592800.704003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592800.704006:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592800.704015:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:3.0:1788592800.704029:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 106 00000100:00100000:3.0:1788592800.704037:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209193728:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592800.704362:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2393:x1875475209193728:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 316us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592800.704793:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 106 00000100:00100000:0.0:1788592800.708543:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209193344 00000100:00100000:0.0:1788592800.708575:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209193344 00000100:00100000:0.0:1788592800.708871:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 373 00000100:00100000:0.0:1788592800.708886:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209193344:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592800.708995:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209193344:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 113us (5966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592800.709004:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 373 00000100:00100000:2.0:1788592801.592963:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174449c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226031360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592801.593033:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592801.593653:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031360 00000100:00100000:3.0:1788592801.593660:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031360 00000100:00100000:3.0:1788592801.593712:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788592801.593721:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226031360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592801.593755:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788592801.593814:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226031360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592801.593821:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788592801.593908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174449c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226031360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592801.594549:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592801.594573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226031488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592801.594624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592801.595142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031488 00000100:00100000:2.0:1788592801.595148:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031488 00000100:00100000:2.0:1788592801.595180:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788592801.595187:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226031488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592801.595209:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592801.595250:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226031488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592801.595256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788592801.595444:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226031488:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788592801.721266:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592802.747783:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592803.303463:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592803.303632:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209194240 00000100:00100000:2.0:1788592803.303642:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209194240 00000100:00100000:2.0:1788592803.303742:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 147 00000100:00100000:2.0:1788592803.303753:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:11070:x1875475209194240:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788592803.304008:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:11070:x1875475209194240:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 Request processed in 256us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592803.304016:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 147 00000100:00080000:1.0:1788592803.304231:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592803.305966:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592803.306049:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209194368 00000100:00100000:1.0:1788592803.306058:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209194368 00000100:00100000:1.0:1788592803.306204:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 148 00000100:00100000:1.0:1788592803.306215:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:11070:x1875475209194368:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788592803.306396:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:11070:x1875475209194368:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 Request processed in 183us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592803.306404:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 148 00000100:00080000:2.0:1788592803.306895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592803.317019:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592803.317640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209194624 00000100:00100000:1.0:1788592803.317650:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209194624 00000100:00100000:1.0:1788592803.317709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:1.0:1788592803.317719:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:11070:x1875475209194624:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592803.318026:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+28:11070:x1875475209194624:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 307us (1013us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788592803.318033:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 35 00000001:00080000:3.0:1788592803.323774:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788592803.323824:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff921743855b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788592803.323830:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921876733800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff921743855840 00000020:00080000:3.0:1788592803.323834:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921876733a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff921846662200 00000020:00080000:3.0:1788592803.323885:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788592803.324259:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788592803.324359:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788592803.324597:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.324612:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.324621:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.324628:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592803.324634:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.324643:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.324666:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff92184f8fa400) 00010000:00010000:1.0:1788592803.324669:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592803.324675:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.324681:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5661 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592803.485420:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592803.485676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209194752 00000100:00100000:1.0:1788592803.485685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209194752 00000100:00100000:1.0:1788592803.485763:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 149 00000100:00100000:1.0:1788592803.485775:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:11876:x1875475209194752:12345-192.168.203.47@tcp:101:lsof.0 00000100:00080000:2.0:1788592803.485782:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592803.485795:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592803.485986:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db56ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f73 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.486159:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.486175:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.486186:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592803.486235:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788592803.486239:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592803.486277:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.486299:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db56ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.486318:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592803.486338:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:1.0:1788592803.486354:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592803.486358:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022ba00, rc 0) 00000100:00100000:1.0:1788592803.486467:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:11876:x1875475209194752:12345-192.168.203.47@tcp:101:lsof.0 Request processed in 695us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592803.486475:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 149 00000100:00100000:3.0:1788592803.641152:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226031616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592803.641232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592803.641624:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031616 00000100:00100000:1.0:1788592803.641633:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031616 00000100:00100000:1.0:1788592803.641704:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788592803.641714:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226031616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592803.641743:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:2.0:1788592803.643959:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592803.644151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475226031872:0@lo:400:kworker.0 00000100:00100000:1.0:1788592803.644385:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226031616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2670us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592803.644397:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788592803.644442:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226032000:0@lo:400:kworker.0 00000100:00100000:1.0:1788592803.644489:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592803.644499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592803.644536:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592803.644556:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226031744:0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.644587:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592803.644604:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031872 00000100:00100000:1.0:1788592803.644613:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031872 00000100:00100000:1.0:1788592803.644678:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788592803.644689:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475226031872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.645731:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226032128:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.645781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592803.645840:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226031616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592803.645879:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032000 00000100:00100000:3.0:1788592803.645884:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032000 00000100:00100000:3.0:1788592803.645916:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032128 00000100:00100000:3.0:1788592803.645919:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032128 00000100:00100000:3.0:1788592803.645935:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788592803.645944:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.645986:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226032000:12345-0@lo:400:kworker.0 Request processed in 43us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.645994:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788592803.646009:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788592803.646015:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226032128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.646180:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226032128:12345-0@lo:400:kworker.0 Request processed in 164us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.646187:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788592803.646228:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226032128:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.646271:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226031744 00000100:00100000:3.0:1788592803.646275:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226031744 00000100:00100000:3.0:1788592803.646302:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788592803.646308:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475226031744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.646789:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226032000:0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.646918:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226032256:0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.646962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592803.647003:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032256 00000100:00100000:2.0:1788592803.647007:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032256 00000100:00100000:2.0:1788592803.647036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788592803.647043:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226032256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.647101:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226032256:12345-0@lo:400:kworker.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592803.647108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788592803.647142:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226032256:0@lo:400:kworker.0 00000001:00080000:2.0:1788592803.647581:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788592803.647589:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:0.0:1788592803.651615:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226032768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.651715:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592803.651768:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788592803.651775:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226032384:0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.651804:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592803.651830:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226032896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.651853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592803.651886:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032768 00000100:00100000:0.0:1788592803.651895:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032768 00000100:00100000:0.0:1788592803.651967:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788592803.651980:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226032768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.652038:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226032768:12345-0@lo:400:kworker.0 Request processed in 61us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592803.652047:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788592803.652284:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475226031744:12345-0@lo:400:kworker.0 Request processed in 5972us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.652295:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788592803.652326:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226032640:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652356:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592803.652378:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226033152:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652401:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592803.652421:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788592803.652428:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226032512:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592803.652470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226033024:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592803.652520:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032640 00000100:00100000:3.0:1788592803.652525:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032640 00000100:00100000:3.0:1788592803.652566:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033152 00000100:00100000:3.0:1788592803.652569:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033152 00000100:00100000:3.0:1788592803.652593:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788592803.652600:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226032640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652638:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226032640:12345-0@lo:400:kworker.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.652645:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788592803.652658:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788592803.652663:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226033152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652690:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226033152:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.652719:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788592803.652750:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032384 00000100:00100000:3.0:1788592803.652755:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032384 00000100:00100000:3.0:1788592803.652777:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032896 00000100:00100000:3.0:1788592803.652780:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032896 00000100:00100000:3.0:1788592803.652791:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226032512 00000100:00100000:3.0:1788592803.652793:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226032512 00000100:00100000:3.0:1788592803.652805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033024 00000100:00100000:3.0:1788592803.652808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033024 00000100:00100000:3.0:1788592803.652822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788592803.652828:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226032384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.652862:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226032384:12345-0@lo:400:kworker.0 Request processed in 34us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.652873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788592803.652885:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788592803.652890:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226032896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.652922:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226031744:0@lo:400:kworker.0 00000100:00080000:0.0:1788592803.653948:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592803.653957:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592803.653961:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592803.653964:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592803.654090:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226032896:12345-0@lo:400:kworker.0 Request processed in 1195us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.654101:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788592803.654131:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788592803.654140:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226032512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.654183:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226032512:12345-0@lo:400:kworker.0 Request processed in 45us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.654189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788592803.654201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788592803.654207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226033024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.654257:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226033024:12345-0@lo:400:kworker.0 Request processed in 50us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592803.654264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00080000:3.0:1788592803.654308:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f486a00 x1875475226032512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592803.654323:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226032512:0@lo:400:kworker.0 00010000:00080000:3.0:1788592803.654335:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186b9f0380 x1875475226033024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592803.654343:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226033024:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.654357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226032640:0@lo:400:kworker.0 00000100:00100000:3.0:1788592803.654369:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226033152:0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.657331:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226032384:0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.657357:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226032896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592803.657370:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788592803.657377:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788592803.657405:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92186f610a80, transno 4294967302 00000004:00080000:0.0:1788592803.658458:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788592803.658482:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92186d50b480, transno 4294967305 00000100:00100000:0.0:1788592803.658556:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226032768:0@lo:400:kworker.0 00000100:00100000:2.0:1788592803.658742:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475226031872:0@lo:400:kworker.0 00000100:00100000:1.0:1788592803.659855:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475226031872:12345-0@lo:400:kworker.0 Request processed in 15163us (15351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592803.659868:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00010000:0.0:1788592803.768331:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592804.153265:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226033280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592804.153338:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592804.153703:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033280 00000100:00100000:1.0:1788592804.153711:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033280 00000100:00100000:1.0:1788592804.153766:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788592804.153776:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226033280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592804.153797:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788592804.154142:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226033280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 365us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592804.154149:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788592804.154753:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226033280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592804.664783:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592804.664807:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226033408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592804.664877:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592804.664966:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033408 00000100:00100000:1.0:1788592804.664981:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033408 00000100:00100000:1.0:1788592804.665030:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788592804.665039:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174449e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226033408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592804.665095:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592804.665147:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174449e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226033408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592804.665154:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788592804.665350:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226033408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592804.672222:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592804.672250:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226033536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592804.672322:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592804.672437:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033536 00000100:00100000:0.0:1788592804.672446:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033536 00000100:00100000:0.0:1788592804.672503:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788592804.672514:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226033536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592804.672546:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592804.672605:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226033536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592804.672612:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788592804.672744:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226033536:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788592804.792325:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592805.820746:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820797:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820825:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820853:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820876:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820900:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820936:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592805.820969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195008 00000100:00100000:2.0:1788592805.820978:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195008 00000100:00100000:2.0:1788592805.821036:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195520 00000100:00100000:2.0:1788592805.821049:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195520 00000100:00100000:2.0:1788592805.821089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195136 00000100:00100000:2.0:1788592805.821092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195136 00000100:00100000:2.0:1788592805.821106:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195648 00000100:00100000:2.0:1788592805.821108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195648 00000100:00100000:2.0:1788592805.821123:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 260 00000100:00100000:2.0:1788592805.821132:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:2394:x1875475209195008:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:2394:x1875475209195008:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 76us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821215:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 260 00000100:00100000:2.0:1788592805.821233:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 261 00000100:00100000:2.0:1788592805.821239:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2394:x1875475209195520:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2394:x1875475209195520:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 261 00000100:00100000:2.0:1788592805.821280:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 262 00000100:00100000:2.0:1788592805.821287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209195136:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821310:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209195136:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821316:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 262 00000100:00100000:2.0:1788592805.821328:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 263 00000100:00100000:2.0:1788592805.821334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209195648:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209195648:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 21us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821360:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 263 00000100:00100000:2.0:1788592805.821388:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209194880 00000100:00100000:2.0:1788592805.821392:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209194880 00000100:00100000:2.0:1788592805.821417:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 375 00000100:00100000:2.0:1788592805.821423:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209194880:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821447:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209194880:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821453:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 375 00000100:00100000:2.0:1788592805.821484:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195264 00000100:00100000:2.0:1788592805.821488:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195264 00000100:00100000:2.0:1788592805.821534:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195392 00000100:00100000:2.0:1788592805.821537:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195392 00000100:00100000:2.0:1788592805.821556:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 110 00000100:00100000:2.0:1788592805.821562:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209195264:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821584:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209195264:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821590:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 110 00000100:00100000:2.0:1788592805.821600:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 111 00000100:00100000:2.0:1788592805.821605:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209195392:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592805.821625:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209195392:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 20us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592805.821630:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 111 00000100:00080000:2.0:1788592805.821647:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592805.821650:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592805.821653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592805.821655:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788592805.821828:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592806.087946:0:14495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:20:04 (1788592804) 00000100:00100000:1.0:1788592806.712653:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592806.712685:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217437bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226033664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592806.712783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592806.713017:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226033792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592806.713057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592806.713415:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033664 00000100:00100000:2.0:1788592806.713443:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033664 00000100:00100000:2.0:1788592806.713506:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226033792 00000100:00100000:2.0:1788592806.713510:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226033792 00000100:00100000:2.0:1788592806.713541:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788592806.713552:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226033664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592806.713598:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592806.713672:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226033664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592806.713681:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788592806.713700:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788592806.713707:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226033792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592806.713726:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788592806.713763:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226033792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592806.713770:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788592806.713937:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217437bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226033664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592806.714137:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226033792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788592806.840332:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592807.161017:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592807.162420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209195904 00000100:00100000:2.0:1788592807.162451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209195904 00000100:00100000:2.0:1788592807.162589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 150 00000100:00100000:2.0:1788592807.162604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:12143:x1875475209195904:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592807.162632:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592807.162660:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db56fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f7a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788592807.162823:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788592807.162987:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163007:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163049:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163666:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163691:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163705:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163822:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db5710 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163832:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db5710 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163839:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db5710 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592807.163850:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788592807.163944:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163951:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163958:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163969:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592807.163985:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.163994:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164612:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:2.0:1788592807.164616:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592807.164621:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164629:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5702 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164644:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164650:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164656:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164660:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820fe00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592807.164663:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164669:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164677:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92174372d100) 00010000:00010000:2.0:1788592807.164679:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592807.164689:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.164695:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5709 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.165405:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ec00/0xbd314a3362db56fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f7a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.165424:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db5710 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f7a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592807.165432:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:2.0:1788592807.165434:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592807.165437:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f200, rc 0) 00000100:00100000:2.0:1788592807.165532:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:12143:x1875475209195904:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 2931us (4529us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788592807.165541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 150 00000100:00100000:2.0:1788592807.171726:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592807.171833:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592807.172353:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196160 00000100:00100000:1.0:1788592807.172363:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196160 00000100:00100000:1.0:1788592807.172429:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:1.0:1788592807.172439:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:2396:x1875475209196160:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592807.172453:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592807.172475:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f200/0xbd314a3362db5710 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f7a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592807.172493:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:1.0:1788592807.172512:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592807.172580:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:2396:x1875475209196160:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 142us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592807.172587:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:3.0:1788592807.173606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196032 00000100:00100000:3.0:1788592807.173613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196032 00000100:00100000:3.0:1788592807.173663:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 151 00000100:00100000:3.0:1788592807.173672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12143:x1875475209196032:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788592807.173765:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12143:x1875475209196032:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 Request processed in 93us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592807.173773:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 151 00000100:00100000:2.0:1788592807.176224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592807.176352:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196288 00000100:00100000:3.0:1788592807.176361:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196288 00000100:00080000:0.0:1788592807.176476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592807.176598:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 152 00000100:00100000:3.0:1788592807.176608:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:12143:x1875475209196288:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788592807.176686:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:12143:x1875475209196288:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 Request processed in 80us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592807.176694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 152 00000040:00080000:2.0:1788592807.416890:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592807.864309:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788592807.928419:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592807.928427:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592807.928936:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788592807.928945:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788592808.443672:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788592808.601302:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.603101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196416 00000100:00100000:2.0:1788592808.603115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196416 00000100:00100000:2.0:1788592808.603174:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 153 00000100:00100000:2.0:1788592808.603187:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12185:x1875475209196416:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592808.603208:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592808.603227:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db571e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f81 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603305:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603320:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603331:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603346:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603353:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603360:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603830:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603837:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603842:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603848:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592808.603852:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603881:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603893:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:2.0:1788592808.603897:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592808.603911:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603918:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603929:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603934:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603939:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.603944:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ea00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592808.604326:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.604336:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.604345:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92174372d100) 00010000:00010000:2.0:1788592808.604347:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592808.604350:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.604365:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db572c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.604423:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db571e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f81 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.604433:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:2.0:1788592808.604435:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592808.604439:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db571e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f81 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.604448:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820ee00, rc 0) 00000100:00100000:2.0:1788592808.605263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12185:x1875475209196416:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2071us (3961us total) trans 0 rc 301/301 00000100:00100000:2.0:1788592808.605275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 153 00000100:00100000:0.0:1788592808.613492:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.613817:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196672 00000100:00100000:2.0:1788592808.613828:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196672 00000100:00100000:2.0:1788592808.613895:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 154 00000100:00100000:2.0:1788592808.613905:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12185:x1875475209196672:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1788592808.613977:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592808.614005:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5072 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2da5 expref: 14 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.614022:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:2.0:1788592808.614027:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592808.614111:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.614130:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.614139:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.614172:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.614187:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 5 pid: 6512 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592808.614202:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f610a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226033920:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592808.614701:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592808.617121:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f610a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226033920:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592808.617151:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592808.630684:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592808.631811:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196800 00000100:00100000:3.0:1788592808.631823:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196800 00010000:00010000:3.0:1788592808.631880:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 6 pid: 6512 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592808.631919:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00100000:3.0:1788592808.631931:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2394:x1875475209196800:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592808.631946:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592808.631953:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 6 pid: 6512 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.631978:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 6 pid: 6512 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.632002:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db56f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f73 expref: 6 pid: 6512 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.632016:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:3.0:1788592808.632022:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.632030:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.632038:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.632082:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592808.632139:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209196800:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 210us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592808.632149:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 80 00000100:00080000:3.0:1788592808.638227:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592808.639289:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.639304:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.639333:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.639360:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.639372:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642211:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642234:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642246:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592808.642272:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb04f3e2 reply state 000000002a28d1ff transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642284:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642291:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff921859546c00) 00010000:00010000:3.0:1788592808.642294:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592808.642299:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788592808.642304:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788592808.642313:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642319:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642325:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642339:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592808.642344:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642352:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642362:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92184f8fab00) 00010000:00010000:3.0:1788592808.642364:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592808.642368:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642373:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5733 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592808.642389:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb04f3e2 reply state 000000002a28d1ff transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642397:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.642404:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff921859546000) 00010000:00010000:3.0:1788592808.642407:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592808.642409:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788592808.642702:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+15:12185:x1875475209196672:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 28794us (29215us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788592808.642711:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 154 00000001:00080000:1.0:1788592808.648299:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:1.0:1788592808.648316:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:3.0:1788592808.648580:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648605:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648613:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648619:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821cb200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592808.648623:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648631:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648646:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff921859546000) 00010000:00010000:3.0:1788592808.648649:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592808.648654:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648660:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db573a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648678:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648684:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648689:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648694:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592808.648703:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648709:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648716:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff921859546c00) 00010000:00010000:3.0:1788592808.648719:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592808.648721:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.648727:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5741 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788592808.648905:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788592808.648920:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788592808.717492:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592808.717573:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209196928 00000100:00100000:3.0:1788592808.717583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209196928 00000100:00100000:3.0:1788592808.717659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 155 00000100:00100000:3.0:1788592808.717670:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:12193:x1875475209196928:12345-192.168.203.47@tcp:101:lctl.0 00010000:00010000:3.0:1788592808.717693:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592808.717717:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f88 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.717790:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db574f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.717805:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.717818:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592808.717860:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788592808.717877:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592808.717902:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.717927:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db5748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f88 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.717946:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db574f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f88 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.717954:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:3.0:1788592808.717957:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592808.717960:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821cb200, rc 0) 00000100:00100000:3.0:1788592808.718027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:12193:x1875475209196928:12345-192.168.203.47@tcp:101:lctl.0 Request processed in 358us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592808.718034:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 155 00000100:00100000:2.0:1788592808.760222:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592808.760245:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226034048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592808.760319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.760386:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034048 00000100:00100000:2.0:1788592808.760395:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034048 00000100:00100000:2.0:1788592808.760551:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788592808.760562:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226034048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592808.760592:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788592808.760597:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226034560:0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.760639:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226034048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592808.760649:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.760650:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788592808.760683:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226035072:0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.760687:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034560 00000100:00100000:2.0:1788592808.760692:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034560 00000100:00100000:0.0:1788592808.760712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.760735:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788592808.760737:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226035584:0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.760745:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226034560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.760762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.760792:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226034560:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.760798:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788592808.760807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226034560:0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.760820:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226035072 00000100:00100000:2.0:1788592808.760824:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226035072 00000100:00100000:0.0:1788592808.760831:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788592808.760842:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226034432:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.760855:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226034176:0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.760867:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592808.760886:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226034944:0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.760906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592808.760921:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226035456:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.760960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592808.760988:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226034688:0@lo:400:kworker.0 00000100:00080000:1.0:1788592808.761024:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592808.761027:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592808.761043:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034432 00000100:00100000:1.0:1788592808.761047:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034432 00000100:00100000:1.0:1788592808.761089:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788592808.761096:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226034432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.761126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592808.761131:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226034432:12345-0@lo:400:kworker.0 Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.761139:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788592808.761171:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226034432:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.761172:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034944 00000100:00100000:1.0:1788592808.761177:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034944 00000100:00100000:1.0:1788592808.761210:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226035456 00000100:00100000:1.0:1788592808.761214:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226035456 00000100:00100000:1.0:1788592808.761238:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788592808.761244:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226034944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.761246:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226035584 00000100:00100000:2.0:1788592808.761249:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226035584 00000100:00100000:2.0:1788592808.761277:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788592808.761282:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226034944:12345-0@lo:400:kworker.0 Request processed in 39us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.761284:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226035072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.761299:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1788592808.761304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592808.761309:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592808.761315:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788592808.761318:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226035072:12345-0@lo:400:kworker.0 Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.761322:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226035456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.761324:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788592808.761334:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788592808.761339:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226035584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.761348:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226035456:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.761354:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788592808.761360:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226035584:12345-0@lo:400:kworker.0 Request processed in 21us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.761365:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788592808.761379:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744527b80 x1875475226034944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592808.761390:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226034944:0@lo:400:kworker.0 00010000:00080000:1.0:1788592808.761401:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921844d4ea00 x1875475226035456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592808.761409:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226035456:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.761419:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226035072:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.761428:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226035584:0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.761514:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592808.761540:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226035200:0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.761571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.761590:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788592808.761597:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788592808.761606:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592808.761615:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226034304:0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.761624:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226034048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592808.761646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592808.761663:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226034816:0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.761688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.761800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034688 00000100:00100000:2.0:1788592808.761805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034688 00000100:00100000:0.0:1788592808.761811:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226035328:0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.761830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034304 00000100:00100000:2.0:1788592808.761834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034304 00000100:00100000:0.0:1788592808.761838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592808.761858:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034816 00000100:00100000:0.0:1788592808.761862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034816 00000100:00100000:2.0:1788592808.762005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226035328 00000100:00100000:2.0:1788592808.762009:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226035328 00000100:00100000:2.0:1788592808.762025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788592808.762031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226034688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.762095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226034688:12345-0@lo:400:kworker.0 Request processed in 63us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.762102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788592808.762114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788592808.762120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226034304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.762145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226034304:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.762151:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788592808.762164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788592808.762170:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475226035328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.762201:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875475226035328:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592808.762208:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788592808.762215:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226034816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592808.762309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226034816:12345-0@lo:400:kworker.0 Request processed in 95us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.762732:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226035200 00000100:00100000:1.0:1788592808.762737:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226035200 00000100:00100000:1.0:1788592808.762768:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788592808.762775:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226035200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.762809:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226035200:12345-0@lo:400:kworker.0 Request processed in 34us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.762815:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788592808.762840:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592808.762843:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592808.763218:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788592808.763227:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788592808.763272:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226034176 00000100:00100000:2.0:1788592808.763278:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226034176 00000100:00100000:2.0:1788592808.763308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788592808.763324:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226034176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592808.763360:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226034176:12345-0@lo:400:kworker.0 Request processed in 38us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.763365:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788592808.763975:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226034304:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.763994:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226034816:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.764003:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226035328:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.764013:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226034176:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.764022:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226034688:0@lo:400:kworker.0 00000100:00100000:1.0:1788592808.764031:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226035200:0@lo:400:kworker.0 00000100:00100000:3.0:1788592808.767308:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592808.769488:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209197056 00000100:00100000:1.0:1788592808.769513:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209197056 00000100:00100000:1.0:1788592808.769582:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 156 00000100:00100000:1.0:1788592808.769593:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:12199:x1875475209197056:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:1.0:1788592808.769613:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592808.769635:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f8f expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769693:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769704:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769715:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769724:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769728:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769742:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769811:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022aa00/0xbd314a3362db576b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769816:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022aa00/0xbd314a3362db576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769820:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022aa00/0xbd314a3362db576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592808.769847:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788592808.769850:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592808.769864:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022aa00/0xbd314a3362db576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769873:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769878:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769882:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769885:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592808.769888:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.769892:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770225:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:1.0:1788592808.770229:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592808.770234:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770251:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db575d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770266:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770272:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770282:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770287:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592808.770290:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770296:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770304:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9218765de800) 00010000:00010000:1.0:1788592808.770306:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592808.770308:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770314:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770412:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f8f expref: 15 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770425:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022aa00/0xbd314a3362db576b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f8f expref: 14 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.770432:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592808.770433:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788592808.770436:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022aa00, rc 0) 00000100:00100000:1.0:1788592808.770549:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12199:x1875475209197056:12345-192.168.203.47@tcp:101:bash.0 Request processed in 957us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.770556:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 156 00000100:00100000:1.0:1788592808.774689:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592808.774823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209197312 00000100:00100000:0.0:1788592808.774831:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209197312 00000100:00100000:0.0:1788592808.774890:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 157 00000100:00100000:0.0:1788592808.774910:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+14:12199:x1875475209197312:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592808.774929:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592808.774950:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5772 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f96 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.775348:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.775365:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.775376:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.775499:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.775517:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.775524:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592808.775848:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788592808.775989:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.776026:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777140:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777185:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777190:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777195:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777198:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592808.777201:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777206:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777215:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592808.777217:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592808.777220:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777225:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5779 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592808.777236:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebfd15ca reply state 00000000223bb3d0 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777260:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777267:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:0.0:1788592808.777269:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592808.777272:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788592808.777312:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5772 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777327:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.777334:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:0.0:1788592808.777337:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592808.777339:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1600, rc 0) 00000100:00100000:0.0:1788592808.777582:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:12199:x1875475209197312:12345-192.168.203.47@tcp:101:bash.0 Request processed in 2680us (2899us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788592808.777591:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 157 00000100:00100000:2.0:1788592808.783006:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592808.783052:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209197440 00000100:00100000:0.0:1788592808.783062:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209197440 00000100:00100000:0.0:1788592808.783151:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:0.0:1788592808.783163:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2395:x1875475209197440:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592808.783179:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592808.783199:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2f9d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592808.783223:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592808.783257:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1788592808.783262:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592808.783272:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.783292:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.783306:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1a00, rc 0) 00000100:00100000:0.0:1788592808.783367:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2395:x1875475209197440:12345-192.168.203.47@tcp:101:bash.0 Request processed in 206us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592808.783373:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00080000:1.0:1788592808.783442:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592808.787250:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592808.787393:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209197568 00000100:00100000:0.0:1788592808.787403:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209197568 00000100:00100000:0.0:1788592808.787521:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:0.0:1788592808.787532:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:12199:x1875475209197568:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592808.787548:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592808.787565:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fa4 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.787594:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.787604:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592808.787608:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592808.787613:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.787657:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.787670:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592808.787682:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744464380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875475226035712:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592808.787761:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592808.792427:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744464380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875475226035712:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592808.792478:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.792520:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1c00, rc 0) 00000100:00100000:0.0:1788592808.792590:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:12199:x1875475209197568:12345-192.168.203.47@tcp:101:bash.0 Request processed in 5060us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592808.792601:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:3.0:1788592808.794468:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592808.794603:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209197696 00000100:00100000:1.0:1788592808.794616:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209197696 00010000:00010000:1.0:1788592808.794668:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592808.794768:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:1.0:1788592808.794780:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209197696:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592808.794802:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592808.794830:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.794871:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.794902:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7a03ef/0xbd314a3362db5795 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f9d expref: 7 pid: 8427 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.794923:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592808.794928:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592808.794938:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.794949:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.795006:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592808.795022:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1875475226035840:192.168.203.47@tcp:105: 00000100:00100000:1.0:1788592808.795410:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184546a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788592808.798559:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1875475226035840:192.168.203.47@tcp:105: 00010000:00010000:0.0:1788592808.798598:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592808.798671:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2396:x1875475209197696:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 3892us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592808.798684:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:0.0:1788592808.801518:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.801625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209197952 00000100:00100000:2.0:1788592808.801638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209197952 00000100:00100000:2.0:1788592808.801750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:2.0:1788592808.801763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+17:12199:x1875475209197952:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:2.0:1788592808.802189:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:12199:x1875475209197952:12345-192.168.203.47@tcp:35:bash.0 Request processed in 428us (694us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788592808.802198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:3.0:1788592808.885561:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592808.885699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209198208 00000100:00100000:0.0:1788592808.885733:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209198208 00000100:00100000:0.0:1788592808.885817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 158 00000100:00100000:0.0:1788592808.885831:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:12209:x1875475209198208:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592808.885868:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592808.885898:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db57a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592808.886378:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000004:00200000:0.0:1788592808.886386:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788592808.886540:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db57a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fab expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592808.886554:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:0.0:1788592808.886562:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:0.0:1788592808.886567:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592808.886574:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db57a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fab expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.886592:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1e00, rc 0) 00000100:00100000:1.0:1788592808.886616:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209198464 00000100:00100000:1.0:1788592808.886622:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209198464 00000100:00100000:0.0:1788592808.886661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:12209:x1875475209198208:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 832us (1114us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788592808.886672:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:0.0:1788592808.886673:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 158 00000100:00100000:1.0:1788592808.886687:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209198464:12345-192.168.203.47@tcp:16:kworker.0 00000100:00100000:1.0:1788592808.886790:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209198464:12345-192.168.203.47@tcp:16:kworker.0 Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.886798:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00010000:00010000:2.0:1788592808.889223:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592808.889283:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209198336 00000100:00100000:3.0:1788592808.889297:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209198336 00002000:00100000:3.0:1788592808.889354:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff921844d4e300 x1875475209198336/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:84/0 lens 504/0 e 0 to 0 dl 1788592819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592808.889367:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921844d4e300 with x1875475209198336 ext(0->12) 00002000:00010000:3.0:1788592808.889374:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921844d4e300 00000100:00100000:3.0:1788592808.889416:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1788592808.889427:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209198336:12345-192.168.203.47@tcp:4:bash.0 00000100:00100000:3.0:1788592808.890790:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2393:x1875475209198336:12345-192.168.203.47@tcp:4:bash.0 Request processed in 1350us (4399us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788592808.890825:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00002000:00100000:3.0:1788592808.890839:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff921844d4e300 x1875475209198336/t4294967306(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:84/0 lens 504/448 e 0 to 0 dl 1788592819 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592808.890852:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921844d4e300 with x1875475209198336 ext(0->12) 00002000:00010000:3.0:1788592808.890858:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff921844d4e300 00000100:00100000:0.0:1788592808.890865:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.891222:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209198720 00000100:00100000:2.0:1788592808.891231:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209198720 00000100:00100000:2.0:1788592808.891898:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:2.0:1788592808.891911:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:12209:x1875475209198720:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592808.892979:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:12209:x1875475209198720:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 1062us (2108us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788592808.892992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:0.0:1788592808.951833:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000040:00080000:3.0:1788592808.952393:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592808.952401:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592808.952550:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1788592808.952568:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592808.953022:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209198848 00000100:00100000:1.0:1788592808.953036:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209198848 00000100:00100000:1.0:1788592808.953129:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 159 00000100:00100000:1.0:1788592808.953140:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:12215:x1875475209198848:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1788592808.953169:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592808.953195:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db57b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fb2 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.953279:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db57b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.953296:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db57b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.953312:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db57b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592808.953365:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788592808.953369:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592808.953392:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db57b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.953422:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db57b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fb2 expref: 22 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.953443:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db57b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fb2 expref: 21 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592808.954661:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592808.954664:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592808.954669:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022ac00, rc 0) 00000100:00100000:1.0:1788592808.954766:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12215:x1875475209198848:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1623us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592808.954775:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 159 00000100:00100000:1.0:1788592808.962287:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592808.962405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209199104 00000100:00100000:0.0:1788592808.962419:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209199104 00000100:00100000:0.0:1788592808.962555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 160 00000100:00100000:0.0:1788592808.962569:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12215:x1875475209199104:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592808.962598:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592808.962643:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db57bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fb9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.962796:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db57c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.962814:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db57c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.962830:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db57c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592808.962844:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788592808.962992:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db57bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fb9 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.963014:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db57c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fb9 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592808.963023:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:0.0:1788592808.963026:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592808.963030:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0800, rc 0) 00000100:00100000:0.0:1788592808.963164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:12215:x1875475209199104:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 592us (888us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788592808.963172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 160 00000100:00100000:0.0:1788592808.967618:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592808.967683:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.967870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209199360 00000100:00100000:2.0:1788592808.967896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209199360 00000100:00100000:2.0:1788592808.967979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 161 00000100:00100000:2.0:1788592808.967992:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:12215:x1875475209199360:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592808.968024:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592808.968114:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fc0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.968254:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db57db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.968273:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db57db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.968288:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db57db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592808.968304:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788592808.968434:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc0 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.968455:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db57db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc0 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.968465:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:2.0:1788592808.968469:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788592808.968473:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820ea00, rc 0) 00000100:00100000:2.0:1788592808.968560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:12215:x1875475209199360:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 570us (955us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788592808.969234:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209199488 00000100:00100000:3.0:1788592808.969243:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209199488 00000100:00100000:3.0:1788592808.969310:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:3.0:1788592808.969320:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+26:2393:x1875475209199488:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592808.969335:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592808.969356:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db57c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fb9 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.969372:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:3.0:1788592808.969376:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592808.969415:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:2393:x1875475209199488:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 96us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592808.969424:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:2.0:1788592808.970732:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 161 00000100:00100000:0.0:1788592808.973270:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.977271:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209199616 00000100:00100000:2.0:1788592808.977291:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209199616 00000100:00100000:2.0:1788592808.977432:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:2.0:1788592808.977446:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209199616:12345-192.168.203.47@tcp:1:lfs.0 00010000:00010000:2.0:1788592808.979654:0:8590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.979692:0:8590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.979702:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592808.979707:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592808.979712:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.979767:0:8590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.979786:0:8590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 8 pid: 8428 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592808.979805:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f613480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226035968:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592808.979910:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592808.982416:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f613480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226035968:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592808.982454:0:8590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592808.986139:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.987918:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209199744 00000100:00100000:2.0:1788592808.987938:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209199744 00010000:00010000:2.0:1788592808.988014:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 9 pid: 8428 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592808.988131:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:2.0:1788592808.988144:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209199744:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592808.988166:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788592808.988188:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788592808.988191:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788592808 00002000:00010000:2.0:1788592808.988194:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788592808 00002000:00010000:2.0:1788592808.988196:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788592808.988203:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 9 pid: 8428 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.988219:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 9 pid: 8428 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.988247:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004012a48b/0xbd314a3362db579c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fa4 expref: 9 pid: 8428 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.988267:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592808.988272:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592808.988279:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.988290:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.988339:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592808.988416:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209199744:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 274us (2289us total) trans 0 rc 0/0 00010000:00010000:3.0:1788592808.988424:0:8590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592808.988425:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 82 00010000:00010000:3.0:1788592808.988434:0:8590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988464:0:8590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988473:0:8590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988481:0:8590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988488:0:8590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ee00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592808.988493:0:8590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988513:0:8590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988527:0:8590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.988534:0:8590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db57e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592808.988592:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209199616:12345-192.168.203.47@tcp:1:lfs.0 Request processed in 11150us (15334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592808.988601:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:3.0:1788592808.992829:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592808.993005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209200000 00000100:00100000:2.0:1788592808.993018:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209200000 00000100:00100000:2.0:1788592808.993133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:2.0:1788592808.993147:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921869698050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:12215:x1875475209200000:12345-192.168.203.47@tcp:35:lfs.0 00000004:00010000:2.0:1788592808.993237:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db57db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc0 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592808.993533:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788592808.993570:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788592808.994553:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1788592808.994613:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.994637:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.994648:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.994765:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.994783:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 28 pid: 6512 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592808.994801:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f613480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1875475226036096:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592808.994984:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592808.997961:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592808.998142:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209200128 00000100:00100000:2.0:1788592808.998144:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f613480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1875475226036096:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592808.998151:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209200128 00010000:00010000:2.0:1788592808.998179:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998195:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 29 pid: 6512 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592808.998236:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 83 00000100:00100000:3.0:1788592808.998247:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:2395:x1875475209200128:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592808.998267:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592808.998275:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 29 pid: 6512 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998290:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 29 pid: 6512 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998317:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f96 expref: 29 pid: 6512 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998336:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:3.0:1788592808.998343:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998354:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998362:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592808.998394:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592808.998416:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592808.998424:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592808.998481:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+28:2395:x1875475209200128:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 235us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592808.998489:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 83 00000001:00080000:2.0:1788592808.998565:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788592808.998709:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788592808.998824:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f613480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226036224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592808.998880:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592808.998919:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592808.999031:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226036224 00000100:00100000:3.0:1788592808.999037:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226036224 00000100:00100000:3.0:1788592808.999113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788592808.999122:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1875475226036224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592808.999326:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1875475226036224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592808.999334:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788592809.002035:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f613480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226036224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788592809.004438:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788592809.004566:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226036352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592809.004660:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592809.004708:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084840 going to sleep for 11 seconds 00000100:00100000:2.0:1788592809.005748:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226036352 00000100:00100000:2.0:1788592809.005763:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226036352 00000100:00100000:2.0:1788592809.005830:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788592809.005842:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1875475226036352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592809.006096:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1875475226036352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 255us (1435us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788592809.006104:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788592809.009956:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226036352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788592809.010243:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788592809.010319:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.010332:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.010341:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.010347:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592809.010353:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.010361:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.010380:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:0.0:1788592809.010383:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788592809.010389:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.010396:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db57f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592809.010561:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788592809.010648:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788592809.010662:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343257594178ns, next at 344257591051ns, rc = 0 00000001:00080000:0.0:1788592809.010669:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788592809.010696:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921742463d00) 00010000:00010000:0.0:1788592809.010700:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788592809.010709:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db57db lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc0 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592809.010850:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921869698050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+31:12215:x1875475209200000:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 17704us (18034us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788592809.010860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 38 00000020:00080000:0.0:1788592809.010867:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788592809.013142:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592809.013319:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209200256 00000100:00100000:3.0:1788592809.013331:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209200256 00000100:00100000:3.0:1788592809.013414:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 162 00000100:00100000:3.0:1788592809.013426:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+31:12215:x1875475209200256:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592809.013456:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592809.013486:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db57f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fc7 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.013705:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db57f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc7 expref: 32 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.013729:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db57f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc7 expref: 32 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.013753:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592809.013756:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592809.013759:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca600, rc 0) 00000100:00100000:3.0:1788592809.013830:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:12215:x1875475209200256:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 407us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592809.013837:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 162 00000100:00080000:1.0:1788592809.013980:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592809.016812:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.016928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209200512 00000100:00100000:2.0:1788592809.016941:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209200512 00000100:00100000:2.0:1788592809.017028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:2.0:1788592809.017041:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:12215:x1875475209200512:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592809.017374:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:12215:x1875475209200512:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 335us (575us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788592809.017382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:2.0:1788592809.089106:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.091684:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209200768 00000100:00100000:0.0:1788592809.091707:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209200768 00000100:00100000:0.0:1788592809.091812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 163 00000100:00100000:0.0:1788592809.091826:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+33:12226:x1875475209200768:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592809.091860:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592809.091890:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db57fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fce expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592809.092024:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788592809.092205:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db57fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fce expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.092224:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:0.0:1788592809.092228:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592809.092234:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db57fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fce expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.092276:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0400, rc 0) 00000100:00100000:0.0:1788592809.092355:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:12226:x1875475209200768:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 533us (4757us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788592809.092364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 163 00000100:00100000:1.0:1788592809.095818:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.095933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209200896 00000100:00100000:2.0:1788592809.095946:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209200896 00000100:00100000:2.0:1788592809.096024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 164 00000100:00100000:2.0:1788592809.096035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:12226:x1875475209200896:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:2.0:1788592809.096440:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096461:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096474:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096486:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096499:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096599:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096628:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096635:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592809.096694:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096708:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096715:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096722:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096728:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592809.096732:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096740:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096752:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592809.096755:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592809.096759:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096766:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db580c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096787:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096793:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096798:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096802:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820fc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592809.096804:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096810:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096816:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:2.0:1788592809.096818:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592809.096821:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096826:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5813 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096835:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096842:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096848:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096858:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592809.096862:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096868:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096877:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592809.096879:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592809.096882:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.096887:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db581a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592809.097104:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:12226:x1875475209200896:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 1068us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592809.097115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 164 00000100:00100000:1.0:1788592809.099579:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.099665:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209201152 00000100:00100000:2.0:1788592809.099679:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209201152 00000100:00100000:2.0:1788592809.099743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:2.0:1788592809.099755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:12226:x1875475209201152:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592809.100042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:12226:x1875475209201152:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 288us (475us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788592809.100051:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:1.0:1788592809.147475:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.147584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209201408 00000100:00100000:0.0:1788592809.147598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209201408 00000100:00100000:0.0:1788592809.147731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 165 00000100:00100000:0.0:1788592809.147745:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:12229:x1875475209201408:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592809.147777:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592809.147804:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5821 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fd5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.147904:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.147923:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.147937:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.147947:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.147962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.147969:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148156:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148166:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148174:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592809.148185:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788592809.148280:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148287:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148295:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148301:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592809.148306:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148316:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148330:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592809.148333:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592809.148338:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148357:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5828 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148375:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148380:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148386:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148391:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592809.148395:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148401:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148410:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:0.0:1788592809.148412:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592809.148415:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148423:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db582f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148468:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5821 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148482:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.148497:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.148499:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592809.148511:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1000, rc 0) 00000100:00100000:0.0:1788592809.148642:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12229:x1875475209201408:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 899us (1180us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788592809.148650:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 165 00000100:00100000:1.0:1788592809.152284:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.152424:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209201536 00000100:00100000:0.0:1788592809.152438:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209201536 00000100:00100000:0.0:1788592809.152561:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 166 00000100:00100000:0.0:1788592809.152574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12229:x1875475209201536:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:0.0:1788592809.152667:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152688:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152703:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152745:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152752:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152760:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152766:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592809.152788:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152797:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152811:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.152815:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592809.152822:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.152828:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5844 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592809.152918:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12229:x1875475209201536:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 346us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592809.152928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 166 00000100:00100000:1.0:1788592809.158384:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.158547:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209201792 00000100:00100000:0.0:1788592809.158560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209201792 00000100:00100000:0.0:1788592809.158644:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:0.0:1788592809.158657:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12229:x1875475209201792:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1788592809.158968:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:12229:x1875475209201792:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 313us (595us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788592809.158977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:3.0:1788592809.272451:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592809.272485:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226036480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592809.272611:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592809.272767:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226036480 00000100:00100000:1.0:1788592809.272779:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226036480 00000100:00100000:1.0:1788592809.272848:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788592809.272861:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226036480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592809.272890:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788592809.272954:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226036480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592809.272963:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788592809.274494:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226036480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592809.390840:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.390998:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209202048 00000100:00100000:2.0:1788592809.391010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209202048 00000100:00100000:2.0:1788592809.391139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 167 00000100:00100000:2.0:1788592809.391168:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:12260:x1875475209202048:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:2.0:1788592809.391201:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592809.391229:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db584b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fdc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.391753:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5852 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.391773:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.391787:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592809.391800:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788592809.391940:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db584b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fdc expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.391962:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fdc expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.391972:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592809.391976:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592809.391980:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820fc00, rc 0) 00000100:00100000:2.0:1788592809.392059:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12260:x1875475209202048:12345-192.168.203.47@tcp:101:cat.0 Request processed in 894us (1234us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788592809.392122:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 167 00000100:00100000:1.0:1788592809.396915:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.397047:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209202176 00000100:00100000:2.0:1788592809.397060:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209202176 00000100:00100000:2.0:1788592809.398087:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:2.0:1788592809.398100:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:2394:x1875475209202176:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592809.398121:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592809.398151:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fdc expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.398175:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592809.398181:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592809.399160:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:2394:x1875475209202176:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 1057us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592809.399172:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:1.0:1788592809.399393:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.399513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209202432 00000100:00100000:2.0:1788592809.399522:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209202432 00000100:00100000:2.0:1788592809.399564:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:2.0:1788592809.399573:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:12260:x1875475209202432:12345-192.168.203.47@tcp:35:cat.0 00000100:00100000:2.0:1788592809.399825:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12260:x1875475209202432:12345-192.168.203.47@tcp:35:cat.0 Request processed in 252us (432us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788592809.399833:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:1.0:1788592809.463870:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.464060:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209202688 00000100:00100000:0.0:1788592809.464134:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209202688 00000100:00100000:0.0:1788592809.464213:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 168 00000100:00100000:0.0:1788592809.464225:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12266:x1875475209202688:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:0.0:1788592809.464269:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592809.464291:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788592809.464325:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db57b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fb2 expref: 40 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.464350:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592809.464356:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592809.464372:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5860 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fe3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.464521:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.464537:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.464546:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.464584:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.464598:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 40 pid: 6513 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592809.464614:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226036608:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592809.464722:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592809.468261:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.468539:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226036608:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592809.468576:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592809.468871:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209202816 00000100:00100000:3.0:1788592809.468880:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209202816 00010000:00010000:3.0:1788592809.469175:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 41 pid: 6513 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592809.469225:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 84 00000100:00100000:3.0:1788592809.469239:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+41:2395:x1875475209202816:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592809.469258:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592809.469266:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 41 pid: 6513 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.469280:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 41 pid: 6513 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.469310:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fd5 expref: 41 pid: 6513 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.469330:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592809.469336:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.469347:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.469370:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.469445:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592809.469519:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:2395:x1875475209202816:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 284us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592809.469528:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 84 00010000:00010000:0.0:1788592809.473470:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.473492:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592809.473540:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788592809.473745:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5860 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.473783:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.473794:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.473798:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592809.473803:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0400, rc 0) 00000100:00100000:0.0:1788592809.474251:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12266:x1875475209202688:12345-192.168.203.47@tcp:101:dd.0 Request processed in 10025us (10392us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788592809.474263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 168 00000100:00100000:1.0:1788592809.478334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.478434:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209202944 00000100:00100000:0.0:1788592809.478448:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209202944 00000100:00100000:0.0:1788592809.478885:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 169 00000100:00100000:0.0:1788592809.478900:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12266:x1875475209202944:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:0.0:1788592809.478957:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592809.478991:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5875 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.479260:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.479279:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.479295:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.479437:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.479459:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.479469:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.479473:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592809.479478:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0000, rc 0) 00000100:00100000:0.0:1788592809.479717:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+41:12266:x1875475209202944:12345-192.168.203.47@tcp:101:dd.0 Request processed in 819us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592809.479726:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 169 00000100:00100000:1.0:1788592809.484241:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.484870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209203200 00000100:00100000:2.0:1788592809.484884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209203200 00000100:00100000:2.0:1788592809.485792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 170 00000100:00100000:2.0:1788592809.485810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+41:12266:x1875475209203200:12345-192.168.203.47@tcp:36:dd.0 00010000:00010000:2.0:1788592809.487375:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.487400:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.487433:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592809.487519:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788592809.487543:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b208c87 reply state 00000000cf0362c9 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.487557:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.487564:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592809.487567:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592809.487571:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592809.487712:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+44:12266:x1875475209203200:12345-192.168.203.47@tcp:36:dd.0 Request processed in 1903us (3479us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788592809.487721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 170 00000020:00080000:2.0:1788592809.487728:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592809.755511:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.755656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209203328 00000100:00100000:0.0:1788592809.755863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209203328 00000100:00100000:0.0:1788592809.756224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 171 00000100:00100000:0.0:1788592809.756237:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+44:12280:x1875475209203328:12345-192.168.203.47@tcp:101:stat.0 00010000:00010000:0.0:1788592809.756327:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592809.756355:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db588a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ff1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756525:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756545:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756561:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756572:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756579:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756586:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756679:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756687:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756695:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756728:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.756748:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 45 pid: 6513 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592809.756762:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226036736:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592809.756975:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592809.759049:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226036736:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592809.759109:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592809.759581:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.759924:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209203584 00000100:00100000:2.0:1788592809.759938:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209203584 00000100:00100000:2.0:1788592809.760016:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:2.0:1788592809.760027:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:6160:x1875475209203584:12345-192.168.203.47@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788592809.760394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:6160:x1875475209203584:12345-192.168.203.47@tcp:35:ldlm_bl.0 Request processed in 367us (812us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788592809.760403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:1.0:1788592809.762193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.762263:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209203712 00000100:00100000:0.0:1788592809.762274:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209203712 00010000:00010000:0.0:1788592809.762328:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 47 pid: 6513 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592809.762377:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 85 00000100:00100000:0.0:1788592809.762387:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:2396:x1875475209203712:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592809.762406:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592809.762413:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 47 pid: 6513 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.762430:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 47 pid: 6513 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.762471:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5867 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fe3 expref: 47 pid: 6513 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.762536:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.762542:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.762555:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.762564:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.762605:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592809.762648:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762660:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592809.762672:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:2396:x1875475209203712:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 285us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592809.762681:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 85 00000004:00200000:3.0:1788592809.762730:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788592809.762735:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592809.762757:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762770:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762782:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762790:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762797:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762804:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592809.762816:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762826:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762839:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592809.762842:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592809.762847:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762854:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5891 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762866:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762872:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762877:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762883:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592809.762885:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762890:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762897:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:3.0:1788592809.762899:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592809.762909:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762916:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db5898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762957:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db588a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff1 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762974:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff1 expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592809.762983:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592809.762987:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592809.762989:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1800, rc 0) 00000100:00100000:3.0:1788592809.763019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+45:12280:x1875475209203328:12345-192.168.203.47@tcp:101:stat.0 Request processed in 6786us (7533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592809.763027:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 171 00000100:00100000:2.0:1788592809.784909:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592809.784945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226036864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592809.785055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592809.785871:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226036864 00000100:00100000:3.0:1788592809.785883:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226036864 00000100:00100000:3.0:1788592809.786007:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788592809.786020:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226036864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592809.786323:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592809.786416:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226036864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 398us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592809.786424:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788592809.786534:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226036864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592809.786601:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226036992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592809.786655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592809.787050:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226036992 00000100:00100000:1.0:1788592809.787057:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226036992 00000100:00100000:1.0:1788592809.787230:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788592809.787240:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226036992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592809.787255:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592809.787342:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226036992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592809.787351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788592809.787461:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226036992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592809.804698:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592809.805541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209203968 00000100:00100000:0.0:1788592809.805555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209203968 00000100:00100000:0.0:1788592809.805694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 172 00000100:00100000:0.0:1788592809.805708:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+45:12286:x1875475209203968:12345-192.168.203.47@tcp:36:truncate.0 00010000:00010000:0.0:1788592809.805790:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592809.805825:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db589f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff1 expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.805850:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.805856:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592809.806135:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.806154:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.806184:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592809.806238:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788592809.806262:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008736ebea reply state 00000000ead184d6 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.806276:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592809.806283:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592809.806286:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592809.806289:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592809.806424:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:12286:x1875475209203968:12345-192.168.203.47@tcp:36:truncate.0 Request processed in 719us (1740us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788592809.806433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 172 00000020:00080000:0.0:1788592809.806439:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788592809.912634:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592809.949896:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592809.950010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209204096 00000100:00100000:2.0:1788592809.950025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209204096 00000100:00100000:2.0:1788592809.950150:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 173 00000100:00100000:2.0:1788592809.950163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:12300:x1875475209204096:12345-192.168.203.47@tcp:101:stat.0 00010000:00010000:2.0:1788592809.950206:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592809.950247:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db58ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2ff8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950339:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950357:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950372:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950385:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950393:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950401:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950539:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950550:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950557:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592809.950626:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788592809.950631:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592809.950659:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950675:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950685:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950691:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950697:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950703:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592809.950709:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950717:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950741:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592809.950744:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592809.950750:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950756:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db58b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950773:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950779:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950785:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950791:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592809.950793:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950799:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950806:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:2.0:1788592809.950808:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592809.950812:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950817:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db58bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950873:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db58ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.950888:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592809.951155:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592809.951158:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592809.951161:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e800, rc 0) 00000100:00100000:2.0:1788592809.951418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+48:12300:x1875475209204096:12345-192.168.203.47@tcp:101:stat.0 Request processed in 1256us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592809.951429:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 173 00000100:00100000:1.0:1788592810.030926:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.031533:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209204352 00000100:00100000:3.0:1788592810.031547:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209204352 00000100:00100000:3.0:1788592810.031652:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 174 00000100:00100000:3.0:1788592810.031710:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+48:12310:x1875475209204352:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592810.031738:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592810.031769:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c2fff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592810.031912:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788592810.032051:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fff expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.032111:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:3.0:1788592810.032115:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592810.032122:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fff expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.032138:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca400, rc 0) 00000100:00100000:3.0:1788592810.032260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:12310:x1875475209204352:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 580us (1346us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788592810.032268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 174 00000100:00100000:0.0:1788592810.035104:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592810.035240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209204608 00000100:00100000:2.0:1788592810.035252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209204608 00000100:00100000:2.0:1788592810.035321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:2.0:1788592810.035333:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921869699450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+49:12310:x1875475209204608:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592810.035628:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921869699450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+50:12310:x1875475209204608:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 296us (562us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788592810.035637:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:2.0:1788592810.100925:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.101841:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209204864 00000100:00100000:0.0:1788592810.101856:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209204864 00000100:00100000:0.0:1788592810.101953:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 175 00000100:00100000:0.0:1788592810.102037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+50:12316:x1875475209204864:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592810.102154:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592810.102186:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db58d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3006 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.102335:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.102374:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.102386:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.102428:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.102444:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 51 pid: 6514 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592810.102459:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b43100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226037120:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592810.102577:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592810.105911:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.106046:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209204992 00000100:00100000:3.0:1788592810.106060:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209204992 00010000:00010000:3.0:1788592810.106150:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 52 pid: 6514 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592810.106208:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 86 00000100:00100000:3.0:1788592810.106220:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:2396:x1875475209204992:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592810.106240:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592810.106250:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 52 pid: 6514 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.106284:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 52 pid: 6514 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.106314:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592810.106320:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.106332:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.106340:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.106366:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592810.106437:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:2396:x1875475209204992:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 219us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592810.106445:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 86 00010000:00010000:0.0:1788592810.106828:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db58c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ff8 expref: 51 pid: 6514 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592810.106851:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b43100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1875475226037120:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592810.106881:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.106893:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.106899:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592810.106922:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788592810.107167:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db58d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.107185:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.107195:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592810.107199:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592810.107202:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0800, rc 0) 00000100:00100000:0.0:1788592810.107242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:12316:x1875475209204864:12345-192.168.203.47@tcp:101:bash.0 Request processed in 5211us (6332us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788592810.107252:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 175 00000100:00100000:3.0:1788592810.110543:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.110641:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209205248 00000100:00100000:0.0:1788592810.110654:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209205248 00000100:00100000:0.0:1788592810.110731:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 176 00000100:00100000:0.0:1788592810.110743:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:12316:x1875475209205248:12345-192.168.203.47@tcp:36:bash.0 00010000:00010000:0.0:1788592810.111106:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.111132:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.111147:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592810.111208:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788592810.111232:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000591bce4c reply state 00000000ccb4107f transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.111248:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.111281:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592810.111284:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592810.111289:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592810.111398:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:12316:x1875475209205248:12345-192.168.203.47@tcp:36:bash.0 Request processed in 656us (870us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788592810.111406:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 176 00000020:00080000:0.0:1788592810.111412:0:13208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788592810.120483:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.121587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209205376 00000100:00100000:3.0:1788592810.121604:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209205376 00000100:00100000:3.0:1788592810.121698:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 177 00000100:00100000:3.0:1788592810.121710:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:12316:x1875475209205376:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592810.121744:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592810.121772:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db58f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c300d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.121893:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.121928:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.121939:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.121986:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592810.122001:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 55 pid: 6512 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592810.122017:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226037248:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592810.122174:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218582066c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592810.128370:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1875475226037248:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592810.128411:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592810.129865:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.131709:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209205504 00000100:00100000:0.0:1788592810.131728:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209205504 00010000:00010000:0.0:1788592810.131793:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 56 pid: 6512 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592810.131905:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 87 00000100:00100000:0.0:1788592810.131928:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:2396:x1875475209205504:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592810.131948:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592810.131966:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 56 pid: 6512 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.131983:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 56 pid: 6512 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.132010:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db58de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3006 expref: 56 pid: 6512 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.132029:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592810.132035:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.132120:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.132130:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.132165:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592810.132235:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:2396:x1875475209205504:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 320us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592810.132243:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 87 00010000:00010000:1.0:1788592810.132655:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.132666:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592810.132738:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788592810.132743:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592810.132768:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.132821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb000/0xbd314a3362db58f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c300d expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.132842:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c300d expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.132851:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:1.0:1788592810.132854:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592810.132857:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9218821ca400, rc 0) 00000100:00100000:1.0:1788592810.132910:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:12316:x1875475209205376:12345-192.168.203.47@tcp:101:bash.0 Request processed in 11202us (12440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.132928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 177 00000100:00100000:2.0:1788592810.150392:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.155360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209205760 00000100:00100000:0.0:1788592810.155389:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209205760 00000100:00100000:0.0:1788592810.155474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:0.0:1788592810.155486:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:12316:x1875475209205760:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:1.0:1788592810.157043:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:12316:x1875475209205760:12345-192.168.203.47@tcp:35:bash.0 Request processed in 1545us (6653us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788592810.157408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:3.0:1788592810.223030:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.226708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209206016 00000100:00100000:0.0:1788592810.226729:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209206016 00000100:00100000:2.0:1788592810.227058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 178 00000100:00100000:2.0:1788592810.227236:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:12326:x1875475209206016:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592810.227271:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592810.227301:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3014 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592810.227438:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788592810.227587:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5901 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3014 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592810.227606:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:2.0:1788592810.227610:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592810.227618:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3014 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592810.227634:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f800, rc 0) 00000100:00100000:2.0:1788592810.227723:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12326:x1875475209206016:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 494us (4708us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1788592810.227731:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 178 00000100:00100000:2.0:1788592810.230518:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592810.230618:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209206144 00000100:00100000:1.0:1788592810.230631:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209206144 00000100:00100000:1.0:1788592810.230711:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 179 00000100:00100000:1.0:1788592810.230724:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12326:x1875475209206144:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:1.0:1788592810.230823:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.231000:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.231018:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.231054:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.231569:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.231583:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.231686:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232478:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232490:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592810.232567:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232584:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232592:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232600:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232608:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592810.232614:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232635:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232651:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592810.232655:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592810.232660:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232667:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db590f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232685:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232704:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232710:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232716:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592810.232720:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232726:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232735:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:1.0:1788592810.232738:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592810.232741:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232758:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5916 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232770:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232776:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232783:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232789:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592810.232792:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232799:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232807:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:1.0:1788592810.232810:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592810.232813:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.232819:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db591d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592810.232983:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12326:x1875475209206144:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 2255us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.232993:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 179 00000100:00100000:1.0:1788592810.243746:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.246397:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209206400 00000100:00100000:3.0:1788592810.246418:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209206400 00000100:00100000:3.0:1788592810.246571:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:3.0:1788592810.246584:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12326:x1875475209206400:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1788592810.246887:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:12326:x1875475209206400:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 304us (3157us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788592810.246896:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:3.0:1788592810.292726:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592810.292804:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209206656 00000100:00100000:1.0:1788592810.292828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209206656 00000100:00100000:1.0:1788592810.292914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 180 00000100:00100000:1.0:1788592810.292926:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+57:12329:x1875475209206656:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1788592810.292966:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592810.292993:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5924 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c301b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.293146:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.293164:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.293178:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.293191:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.293199:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.293209:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293407:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293421:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293430:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592810.293443:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788592810.293585:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293593:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293624:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293631:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592810.293636:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293646:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293662:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592810.293665:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592810.293671:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293679:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db592b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293695:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293702:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293708:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293713:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592810.293716:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293733:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293742:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:0.0:1788592810.293745:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592810.293748:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293754:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293804:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5924 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c301b expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293819:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c301b expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.293826:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592810.293829:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592810.293831:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0800, rc 0) 00000100:00100000:0.0:1788592810.293904:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12329:x1875475209206656:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 980us (1194us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788592810.293914:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 180 00000100:00100000:2.0:1788592810.305888:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592810.305943:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.306103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209206784 00000100:00100000:0.0:1788592810.306113:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209206784 00000100:00100000:0.0:1788592810.306183:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 181 00000100:00100000:0.0:1788592810.306192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12329:x1875475209206784:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:0.0:1788592810.306273:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306292:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306304:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306347:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306355:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306362:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306368:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592810.306372:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306379:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306388:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592810.306392:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592810.306396:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.306401:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5947 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592810.306486:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12329:x1875475209206784:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 294us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592810.306503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 181 00000100:00100000:3.0:1788592810.308370:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209206912 00000100:00100000:3.0:1788592810.308383:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209206912 00000100:00100000:2.0:1788592810.308605:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592810.308620:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:2395:x1875475209206912:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592810.308638:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592810.308660:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c301b expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592810.308696:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592810.308702:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592810.308764:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:2395:x1875475209206912:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 148us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592810.308772:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592810.311350:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592810.311460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209207168 00000100:00100000:1.0:1788592810.311469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209207168 00000100:00100000:1.0:1788592810.311590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:1.0:1788592810.311600:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:12329:x1875475209207168:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:1.0:1788592810.311816:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12329:x1875475209207168:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 217us (473us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788592810.311824:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:3.0:1788592810.454471:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592810.454622:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209207424 00000100:00100000:1.0:1788592810.454636:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209207424 00000100:00100000:1.0:1788592810.454726:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:1.0:1788592810.454739:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12347:x1875475209207424:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:1.0:1788592810.454771:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592810.454798:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db594e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3022 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.454951:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db5955 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.454970:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db5955 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.454984:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db5955 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592810.454997:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788592810.455198:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ac00/0xbd314a3362db594e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3022 expref: 62 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.455221:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db5955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3022 expref: 61 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592810.455232:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:1.0:1788592810.455254:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788592810.455260:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a400, rc 0) 00000100:00100000:1.0:1788592810.455335:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:12347:x1875475209207424:12345-192.168.203.47@tcp:101:cat.0 Request processed in 597us (878us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788592810.455343:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 182 00000100:00100000:2.0:1788592810.484739:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.484947:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209207552 00000100:00100000:0.0:1788592810.484961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209207552 00000100:00100000:0.0:1788592810.485134:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 183 00000100:00100000:0.0:1788592810.485147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:12348:x1875475209207552:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592810.485178:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592810.485204:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3029 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.485287:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db596a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.485304:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db596a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.485318:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db596a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592810.485370:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788592810.485374:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592810.485395:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db596a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.485424:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3029 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.485445:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db596a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3029 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.485464:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592810.485467:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592810.485472:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0a00, rc 0) 00000100:00100000:0.0:1788592810.485560:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12348:x1875475209207552:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 416us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592810.485568:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 183 00000100:00100000:2.0:1788592810.492030:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.497965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209207936 00000100:00100000:3.0:1788592810.497987:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209207936 00000100:00100000:3.0:1788592810.498568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:3.0:1788592810.498587:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12348:x1875475209207936:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1788592810.498998:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12348:x1875475209207936:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 416us (6982us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788592810.499871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:3.0:1788592810.502303:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592810.509700:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208064 00000100:00100000:2.0:1788592810.509718:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208064 00000100:00100000:2.0:1788592810.509883:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:2.0:1788592810.509895:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12348:x1875475209208064:12345-192.168.203.47@tcp:103:lfs.0 00010000:00010000:2.0:1788592810.509912:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788592810.509937:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca400/0xbd314a3362db58fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c300d expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592810.509961:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a400/0xbd314a3362db5955 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3022 expref: 62 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592810.509985:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca600/0xbd314a3362db57f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fc7 expref: 61 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592810.509997:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592810.510003:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592810.510102:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:12348:x1875475209208064:12345-192.168.203.47@tcp:103:lfs.0 Request processed in 175us (7778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592810.510123:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:3.0:1788592810.524027:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.525943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208192 00000100:00100000:0.0:1788592810.525965:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208192 00000100:00100000:0.0:1788592810.526063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 184 00000100:00100000:0.0:1788592810.526203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:12348:x1875475209208192:12345-192.168.203.47@tcp:58:lfs.0 00010000:00010000:0.0:1788592810.526361:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.526383:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.526401:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592810.526537:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788592810.526688:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:12348:x1875475209208192:12345-192.168.203.47@tcp:58:lfs.0 Request processed in 489us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592810.529308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 184 00000100:00100000:1.0:1788592810.549193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592810.549297:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208320 00000100:00100000:0.0:1788592810.549311:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208320 00000100:00100000:0.0:1788592810.549390:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 185 00000100:00100000:0.0:1788592810.549402:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:12350:x1875475209208320:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592810.549447:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592810.549477:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5978 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3030 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549574:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549593:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549607:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549623:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549630:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549637:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549723:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549734:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.549741:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592810.549791:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788592810.549802:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592810.551186:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551209:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551222:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551229:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551238:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551244:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592810.551249:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551257:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551272:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592810.551276:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592810.551281:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551289:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db597f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551307:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551332:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551338:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551343:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592810.551346:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551354:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551363:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:0.0:1788592810.551366:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592810.551369:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551375:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5986 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551417:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5978 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 62 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551433:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 61 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592810.551440:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592810.551443:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592810.551455:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1800, rc 0) 00000100:00100000:0.0:1788592810.551557:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:12350:x1875475209208320:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2156us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592810.551568:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 185 00000100:00100000:3.0:1788592810.934315:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.934358:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.934413:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.934435:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.934457:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.934481:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592810.934522:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208704 00000100:00100000:3.0:1788592810.934534:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208704 00000100:00100000:3.0:1788592810.934601:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208832 00000100:00100000:3.0:1788592810.934604:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208832 00000100:00100000:3.0:1788592810.934631:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:3.0:1788592810.934643:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2393:x1875475209208704:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592810.934735:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2393:x1875475209208704:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592810.934756:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:1.0:1788592810.934867:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208448 00000100:00100000:1.0:1788592810.934872:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208448 00000100:00100000:1.0:1788592810.934907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 377 00000100:00100000:1.0:1788592810.934917:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2393:x1875475209208448:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592810.934948:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fde4749-eba3-4045-af7c-c124eb85a251+13:2393:x1875475209208448:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.934960:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 377 00000100:00100000:1.0:1788592810.935004:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208576 00000100:00100000:1.0:1788592810.935008:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208576 00000100:00100000:1.0:1788592810.935041:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209208960 00000100:00100000:1.0:1788592810.935045:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209208960 00000100:00100000:1.0:1788592810.935095:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209209088 00000100:00100000:1.0:1788592810.935099:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209209088 00000100:00100000:1.0:1788592810.935120:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 270 00000100:00100000:1.0:1788592810.935127:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209208576:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592810.935165:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209208576:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 38us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.935173:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 270 00000100:00100000:1.0:1788592810.935187:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 271 00000100:00100000:1.0:1788592810.935194:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209208960:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592810.935218:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2393:x1875475209208960:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.935232:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 271 00000100:00100000:1.0:1788592810.935245:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 272 00000100:00100000:1.0:1788592810.935252:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209209088:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592810.935276:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209209088:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.935282:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 272 00000100:00100000:1.0:1788592810.935305:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:1.0:1788592810.935312:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209208832:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592810.935340:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2394:x1875475209208832:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592810.935347:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00080000:2.0:1788592810.936335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592810.936343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592810.936346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592810.936350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788592810.937363:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788592811.001419:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592811.001431:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592811.001464:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788592811.001471:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592811.001637:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226037376:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592811.001751:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184546a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592811.008368:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.008462:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209209216 00000100:00100000:2.0:1788592811.008475:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209209216 00000100:00100000:2.0:1788592811.008575:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 186 00000100:00100000:2.0:1788592811.008588:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209209216:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592811.008632:0:10029:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592811.008774:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209209216:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.008783:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 186 00000100:00080000:3.0:1788592811.009273:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592811.009427:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226037376:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788592811.012725:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.012791:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209209344 00000100:00100000:3.0:1788592811.012805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209209344 00000100:00100000:3.0:1788592811.012881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 187 00000100:00100000:3.0:1788592811.012895:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:12361:x1875475209209344:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788592811.013004:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013027:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013052:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013107:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013116:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013123:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013155:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013165:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.013187:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592811.013257:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788592811.013262:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592811.013291:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014202:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014214:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014223:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014238:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592811.014243:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014252:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014269:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:3.0:1788592811.014272:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592811.014277:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014484:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5994 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014530:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014537:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014544:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014549:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592811.014552:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014558:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014566:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff921882176300) 00010000:00010000:3.0:1788592811.014568:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592811.014572:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014578:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db599b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014594:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014600:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014606:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014619:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592811.014622:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014628:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014635:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592811.014637:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592811.014640:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.014646:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db59a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.014823:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:12361:x1875475209209344:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 Request processed in 1926us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.014836:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 187 00000100:00100000:2.0:1788592811.018675:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592811.018869:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209209600 00000100:00100000:0.0:1788592811.018883:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209209600 00000100:00100000:0.0:1788592811.018959:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 188 00000100:00100000:0.0:1788592811.018973:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+61:12361:x1875475209209600:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592811.019139:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592811.019168:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3037 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019312:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019332:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019347:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592811.019359:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788592811.019462:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019470:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019477:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019513:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.019519:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019528:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019543:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592811.019547:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592811.019553:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019561:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019908:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3037 expref: 63 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019928:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:0.0:1788592811.019931:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592811.019939:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3037 expref: 63 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.019950:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1a00, rc 0) 00000100:00100000:0.0:1788592811.020559:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209209600:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 1586us (1895us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788592811.020570:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 188 00000100:00100000:3.0:1788592811.025603:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.025706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209209728 00000100:00100000:2.0:1788592811.025719:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209209728 00000100:00100000:2.0:1788592811.025797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 189 00000100:00100000:2.0:1788592811.025810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209209728:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592811.025862:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592811.026012:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209209728:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 205us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.026020:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 189 00000100:00100000:3.0:1788592811.029272:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.029636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209209984 00000100:00100000:2.0:1788592811.029677:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209209984 00000100:00100000:2.0:1788592811.029748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 190 00000100:00100000:2.0:1788592811.029759:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209209984:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592811.029784:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592811.029788:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788592811.029823:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0a00/0xbd314a3362db596a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3029 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.029846:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592811.029851:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592811.029868:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db59be lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c303e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592811.030345:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788592811.030549:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db59c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.030565:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.030576:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.030630:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db59be lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c303e expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.030645:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db59c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c303e expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.030669:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372dc00) 00010000:00010000:2.0:1788592811.030672:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592811.030676:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e200, rc 0) 00000100:00100000:2.0:1788592811.030752:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12361:x1875475209209984:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 995us (1494us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788592811.030761:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 190 00000100:00100000:1.0:1788592811.039145:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592811.039247:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209210240 00000100:00100000:0.0:1788592811.039281:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209210240 00000100:00100000:0.0:1788592811.039360:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 191 00000100:00100000:0.0:1788592811.039373:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12361:x1875475209210240:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592811.039460:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592811.039509:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db59c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c303e expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039535:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372dc00) 00010000:00010000:0.0:1788592811.039549:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592811.039584:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039601:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039612:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039628:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039636:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039641:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039690:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039695:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039705:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039710:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.039713:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039719:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039726:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592811.039728:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592811.039731:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039735:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db59d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039741:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039744:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039748:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039752:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.039753:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039764:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039773:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xdeed9478 (ffff921742463d00) 00010000:00010000:0.0:1788592811.039775:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592811.039778:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.039783:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db59da lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdeed9478 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592811.040174:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209210240:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 802us (1042us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592811.040183:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 191 00000100:00100000:3.0:1788592811.042582:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.042663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209210368 00000100:00100000:2.0:1788592811.042675:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209210368 00000100:00100000:2.0:1788592811.042777:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:2.0:1788592811.042790:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+62:12361:x1875475209210368:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592811.042816:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592811.042849:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db59e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3045 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.042894:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.042912:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.042926:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.043124:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db59e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.043147:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.043167:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:2.0:1788592811.043171:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592811.043175:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f400, rc 0) 00000100:00100000:2.0:1788592811.043237:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12361:x1875475209210368:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 449us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.043245:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 192 00000100:00100000:3.0:1788592811.045850:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592811.045925:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209210624 00000100:00100000:1.0:1788592811.045937:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209210624 00000100:00100000:1.0:1788592811.046015:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 193 00000100:00100000:1.0:1788592811.046026:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12361:x1875475209210624:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592811.046208:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.046229:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.046243:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592811.046465:0:10029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788592811.046476:0:10029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345293408381ns, next at 346293405126ns, rc = 0 00000004:00010000:1.0:1788592811.046547:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c209dde reply state 000000009dadacbf transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.046561:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.046570:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:1.0:1788592811.046573:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788592811.046577:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592811.046682:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12361:x1875475209210624:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 658us (853us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788592811.046690:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 193 00000100:00100000:2.0:1788592811.049680:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592811.050168:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209210752 00000100:00100000:0.0:1788592811.050183:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209210752 00000100:00100000:0.0:1788592811.050257:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 194 00000100:00100000:0.0:1788592811.050269:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12361:x1875475209210752:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592811.050299:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592811.050325:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c304c expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.050402:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 66 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.050421:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 66 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.050470:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592811.050475:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592811.050480:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1400, rc 0) 00000100:00100000:0.0:1788592811.050567:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12361:x1875475209210752:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 300us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592811.050576:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 194 00000100:00100000:2.0:1788592811.059255:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.059383:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209210880 00000100:00100000:3.0:1788592811.059400:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209210880 00000100:00100000:3.0:1788592811.059474:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:3.0:1788592811.059486:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+6:2393:x1875475209210880:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788592811.059781:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2393:x1875475209210880:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 297us (539us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788592811.059790:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:2.0:1788592811.062462:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.062608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209211136 00000100:00100000:3.0:1788592811.062621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209211136 00000100:00100000:3.0:1788592811.062706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:3.0:1788592811.062718:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12361:x1875475209211136:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788592811.063007:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12361:x1875475209211136:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 290us (555us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788592811.063016:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:2.0:1788592811.064885:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.064976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209211392 00000100:00100000:3.0:1788592811.064986:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209211392 00000100:00100000:3.0:1788592811.065047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 195 00000100:00100000:3.0:1788592811.065058:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12361:x1875475209211392:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788592811.065206:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12361:x1875475209211392:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 149us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592811.065219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 195 00000100:00100000:0.0:1788592811.068604:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.068933:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209211520 00000100:00100000:2.0:1788592811.068945:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209211520 00000100:00100000:2.0:1788592811.069567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 196 00000100:00100000:2.0:1788592811.069582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12361:x1875475209211520:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592811.069608:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592811.069638:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db59fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3053 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.069744:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.069762:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.069778:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592811.069848:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592811.069874:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.069905:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db59fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3053 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.069921:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3053 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.069930:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:2.0:1788592811.069933:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788592811.069938:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e000, rc 0) 00000100:00100000:2.0:1788592811.070020:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12361:x1875475209211520:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 443us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.070028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 196 00000100:00100000:0.0:1788592811.072874:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.072968:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209211648 00000100:00100000:2.0:1788592811.072980:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209211648 00000100:00100000:2.0:1788592811.073049:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:2.0:1788592811.073060:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209211648:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592811.073101:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592811.073128:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c305a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592811.073158:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc2aa, blocks: 0x0 00010000:00010000:2.0:1788592811.073183:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788592811.073196:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592811.073208:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.073230:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.073246:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820ea00, rc 0) 00000100:00100000:2.0:1788592811.073319:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209211648:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 261us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.073328:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:2.0:1788592811.083853:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.083946:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209211904 00000100:00100000:3.0:1788592811.083958:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209211904 00000100:00100000:3.0:1788592811.084028:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 197 00000100:00100000:3.0:1788592811.084040:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12361:x1875475209211904:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788592811.084286:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12361:x1875475209211904:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 247us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592811.084294:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 197 00000100:00100000:3.0:1788592811.091441:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592811.091852:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212032 00000100:00100000:1.0:1788592811.091865:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212032 00000100:00100000:1.0:1788592811.092036:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1788592811.092049:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:12361:x1875475209212032:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592811.092100:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592811.092125:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3061 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.092176:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.092188:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592811.092194:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592811.092201:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.092244:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.092261:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592811.092278:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875475226037504:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592811.092378:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184546a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592811.094282:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875475226037504:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592811.094326:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.094684:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a200, rc 0) 00000100:00100000:2.0:1788592811.094756:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:12361:x1875475209212032:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 2708us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.094767:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:3.0:1788592811.095531:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.095603:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212160 00000100:00100000:2.0:1788592811.095611:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212160 00010000:00010000:2.0:1788592811.095650:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.095687:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:2.0:1788592811.095702:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2395:x1875475209212160:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592811.095720:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592811.095745:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.095761:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.095788:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a77dba68/0xbd314a3362db5a0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c305a expref: 9 pid: 8428 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.095803:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592811.095808:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592811.095817:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.095828:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.095866:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.095883:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10331:1875475226037632:192.168.203.47@tcp:105: 00000100:00100000:2.0:1788592811.097399:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592811.104421:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10331:1875475226037632:192.168.203.47@tcp:105: 00010000:00010000:2.0:1788592811.104467:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592811.104554:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209212160:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 8851us (9024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.104568:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 88 00000100:00100000:1.0:1788592811.106345:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.106427:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212288 00000100:00100000:3.0:1788592811.106437:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212288 00002000:00100000:3.0:1788592811.106513:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9217445adc00 x1875475209212288/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:87/0 lens 504/0 e 0 to 0 dl 1788592822 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592811.106541:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9217445adc00 with x1875475209212288 ext(0->8) 00002000:00010000:3.0:1788592811.106548:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9217445adc00 00000100:00100000:3.0:1788592811.106589:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:3.0:1788592811.106600:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209212288:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788592811.109280:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2395:x1875475209212288:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 Request processed in 2669us (2931us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788592811.109298:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00002000:00100000:3.0:1788592811.109312:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9217445adc00 x1875475209212288/t4294967315(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:87/0 lens 504/448 e 0 to 0 dl 1788592822 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592811.109324:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9217445adc00 with x1875475209212288 ext(0->8) 00002000:00010000:3.0:1788592811.109331:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9217445adc00 00000100:00100000:1.0:1788592811.113473:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.113566:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212416 00000100:00100000:2.0:1788592811.113580:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212416 00000100:00100000:2.0:1788592811.113660:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 198 00000100:00100000:2.0:1788592811.113672:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12361:x1875475209212416:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788592811.119042:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788592811.119084:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788592811.119160:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788592811.119183:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92184fea0d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788592811.119189:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9218460c8f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92184fea0240 00000020:00080000:1.0:1788592811.119193:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9218460c8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff921847591200 00000100:00100000:1.0:1788592811.119370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226037760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788592811.119463:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592811.119543:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226037760 00000100:00100000:1.0:1788592811.119552:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226037760 00000100:00100000:1.0:1788592811.119621:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592811.119632:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226037760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788592811.119668:0:10091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1788592811.119710:0:10091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bc2a8, atime: 0x0, ctime: 0x6a9bc2a8, blocks: 0x8 00010000:00010000:1.0:1788592811.119720:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.119741:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788592811.119747:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592811.119756:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.119777:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.119790:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.119799:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.119818:0:10091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788592811.119998:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3640:x1875475226037760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 366us (534us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788592811.120015:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788592811.120042:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788592811.120108:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9217445afb80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788592811.120115:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226037760:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788592811.121317:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788592811.121379:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788592811.121407:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592811.121416:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.121429:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592811.121434:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.121447:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.121472:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.121481:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db5a19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.121533:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592811.121536:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592811.121538:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592811.121556:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226037888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788592811.121616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592811.121672:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226037888 00000100:00100000:2.0:1788592811.121679:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226037888 00000100:00100000:2.0:1788592811.121733:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788592811.121742:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226037888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788592811.121861:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788592811.121865:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788592811 00002000:00010000:2.0:1788592811.121867:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788592811.121870:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788592810 -> 1788592811 00002000:00010000:2.0:1788592811.121873:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788592811.121911:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226037888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (295us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788592811.121919:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788592811.121946:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788592811.121972:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9217445bed80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788592811.121979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226037888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788592811.122332:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:12361:x1875475209212416:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 Request processed in 8659us (8869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.122342:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 198 00010000:00010000:0.0:1788592811.123343:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123364:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123372:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123379:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.123386:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123394:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123413:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921742463400) 00010000:00010000:0.0:1788592811.123417:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592811.123423:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123440:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1200/0xbd314a3362db5780 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123470:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123477:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123483:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123500:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820fc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.123503:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123509:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123518:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592811.123521:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592811.123524:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123530:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5883 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123540:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123546:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123557:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123561:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.123565:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123571:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123579:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592811.123581:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592811.123584:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123591:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db58a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123601:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123608:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123613:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123617:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.123619:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123633:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123641:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:0.0:1788592811.123643:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592811.123645:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123651:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db58ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123662:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123668:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123674:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123680:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022bc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592811.123682:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123688:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123696:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592811.123698:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592811.123701:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.123716:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db59ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592811.124591:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.124678:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212544 00000100:00100000:3.0:1788592811.124691:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212544 00000100:00100000:3.0:1788592811.124757:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1788592811.124776:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2396:x1875475209212544:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788592811.127022:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788592811.127042:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788592811.127338:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209212544:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 Request processed in 2555us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592811.127352:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:1.0:1788592811.132155:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592811.132537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212800 00000100:00100000:0.0:1788592811.132552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212800 00000100:00100000:0.0:1788592811.132685:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 199 00000100:00100000:0.0:1788592811.132699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:12361:x1875475209212800:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592811.132777:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592811.132814:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3053 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.132836:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592811.132842:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592811.132882:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.132900:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.132913:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592811.133131:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b640f2bc reply state 000000001ceef212 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.133145:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.133164:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592811.133166:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592811.133170:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592811.133289:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:12361:x1875475209212800:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 593us (1148us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788592811.133298:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 199 00000100:00100000:1.0:1788592811.142449:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.142548:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209212928 00000100:00100000:3.0:1788592811.142560:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209212928 00000100:00100000:3.0:1788592811.142739:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:3.0:1788592811.142753:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209212928:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788592811.142955:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788592811.142966:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788592811 -> 1788592810 00002000:00010000:3.0:1788592811.142969:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788592808 00002000:00010000:3.0:1788592811.142971:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788592811 -> 1788592810 00002000:00010000:3.0:1788592811.142973:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788592811.143052:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209212928:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 302us (615us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788592811.143062:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:1.0:1788592811.153251:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.156843:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209213184 00000100:00100000:3.0:1788592811.156865:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209213184 00000100:00100000:3.0:1788592811.157671:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:3.0:1788592811.157689:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:12361:x1875475209213184:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788592811.157783:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.157804:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.157815:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.157860:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.157876:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 20 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.157893:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226038016:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592811.158022:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592811.170432:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592811.171870:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209213312 00000100:00100000:0.0:1788592811.171886:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209213312 00010000:00010000:0.0:1788592811.171943:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 21 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592811.171998:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 89 00000100:00100000:0.0:1788592811.172009:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:2395:x1875475209213312:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592811.172028:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592811.172038:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 21 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.172055:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 21 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.172115:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592811.172122:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.172136:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.172145:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.172178:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592811.172247:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:2395:x1875475209213312:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 238us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592811.172256:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 89 00010000:00010000:3.0:1788592811.173286:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db59e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3045 expref: 20 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.173380:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226038016:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592811.173409:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173463:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173484:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173543:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173552:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173560:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173566:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592811.173571:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173581:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173597:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:2.0:1788592811.173601:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788592811.173606:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.173611:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a27 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.173680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:12361:x1875475209213184:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 Request processed in 15997us (20444us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788592811.173690:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 200 00000100:00100000:3.0:1788592811.179126:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592811.179769:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209213440 00000100:00100000:0.0:1788592811.179784:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209213440 00000100:00100000:0.0:1788592811.179867:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:0.0:1788592811.179880:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209213440:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788592811.179937:0:8590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.179964:0:8590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.179974:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592811.179979:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592811.179986:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.180032:0:8590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.180050:0:8590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 8 pid: 8427 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592811.180085:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8590:1875475226038144:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592811.180198:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217410849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592811.183136:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8590:1875475226038144:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592811.183174:0:8590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.184838:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.184880:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209213568 00000100:00100000:2.0:1788592811.184892:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209213568 00010000:00010000:2.0:1788592811.184947:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 9 pid: 8427 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.184998:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 90 00000100:00100000:2.0:1788592811.185009:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209213568:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592811.185027:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592811.185053:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 9 pid: 8427 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.185104:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 9 pid: 8427 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.185133:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5762cbd/0xbd314a3362db5a12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3061 expref: 9 pid: 8427 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.185152:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592811.185157:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592811.185164:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.185175:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.185216:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592811.185281:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209213568:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 273us (452us total) trans 0 rc 0/0 00010000:00010000:3.0:1788592811.185292:0:8590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.185299:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 90 00010000:00010000:3.0:1788592811.185309:0:8590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185335:0:8590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185344:0:8590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185353:0:8590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185361:0:8590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592811.185367:0:8590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185393:0:8590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185407:0:8590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.185416:0:8590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd959a7/0xbd314a3362db5a2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.185471:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209213440:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 Request processed in 5594us (6359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592811.185481:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:1.0:1788592811.187427:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.187520:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209213824 00000100:00100000:3.0:1788592811.187532:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209213824 00000100:00100000:3.0:1788592811.187593:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 201 00000100:00100000:3.0:1788592811.187604:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:12361:x1875475209213824:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788592811.187969:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.187991:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.188004:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.188046:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.188096:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 19 pid: 6512 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.188115:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226038272:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592811.188226:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592811.193288:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226038272:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592811.193327:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592811.193945:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.194250:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209213952 00000100:00100000:2.0:1788592811.194261:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209213952 00010000:00010000:2.0:1788592811.194306:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 20 pid: 6512 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.194377:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 91 00000100:00100000:2.0:1788592811.194386:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:2393:x1875475209213952:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592811.194401:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592811.194407:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 20 pid: 6512 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.194418:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 20 pid: 6512 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.194440:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db587c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2fea expref: 20 pid: 6512 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.194452:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:2.0:1788592811.194457:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.194467:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.194473:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.194525:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592811.194597:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:2393:x1875475209213952:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 211us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.194605:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 91 00010000:00010000:3.0:1788592811.194657:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.194667:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.194872:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.194886:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 19 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.194896:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.194930:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 19 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.194946:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 19 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.194970:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226038400:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592811.195040:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592811.197554:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592811.197685:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209214080 00000100:00100000:2.0:1788592811.197697:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209214080 00010000:00010000:2.0:1788592811.197751:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 20 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.197765:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226038400:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592811.197798:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.197808:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 92 00000100:00100000:2.0:1788592811.197821:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:2396:x1875475209214080:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592811.197853:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592811.197863:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 20 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.197877:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 20 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.197907:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db59f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c304c expref: 20 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.197924:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:2.0:1788592811.197930:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.197941:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.197962:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592811.197995:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592811.198053:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.198207:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592811.198270:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:2396:x1875475209214080:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 452us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.198277:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 92 00000001:00080000:3.0:1788592811.198342:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788592811.198479:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788592811.198527:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788592811.198612:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10029:1875475226038528:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788592811.198782:0:10029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592811.198813:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592811.198832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226038528 00000100:00100000:2.0:1788592811.198848:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226038528 00000100:00100000:2.0:1788592811.198891:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788592811.198910:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10029:x1875475226038528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788592811.199017:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10029:x1875475226038528:12345-0@lo:1000:mdt00_003.0 Request processed in 114us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.199025:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788592811.199648:0:10029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788592811.199658:0:10029:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9217445bed80, transno 4294967316 00000100:00100000:3.0:1788592811.199683:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10029:1875475226038528:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788592811.199839:0:10029:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788592811.199893:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10029:1875475226038656:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788592811.199962:0:10029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592811.199987:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592811.200020:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226038656 00000100:00100000:1.0:1788592811.200026:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226038656 00000100:00100000:1.0:1788592811.200096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788592811.200107:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10029:x1875475226038656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788592811.200841:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10029:x1875475226038656:12345-0@lo:1000:mdt00_003.0 Request processed in 736us (877us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788592811.200850:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788592811.200981:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10029:1875475226038656:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788592811.201040:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201051:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201060:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201105:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592811.201111:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201121:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201140:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:3.0:1788592811.201144:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592811.201150:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201159:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201199:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201207:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201213:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201230:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592811.201234:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201241:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201252:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592811.201255:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592811.201259:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201265:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1c00/0xbd314a3362db5971 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201295:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201312:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 22 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201323:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201357:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 22 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.201374:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 22 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.201404:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226038784:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592811.201500:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b207a80 going to sleep for 11 seconds 00000040:00080000:0.0:1788592811.205116:0:14642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592811.205129:0:14642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592811.205167:0:14642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:0.0:1788592811.205176:0:14642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592811.210395:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226038784:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592811.210434:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592811.210522:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.210619:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209214208 00000100:00100000:3.0:1788592811.210631:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209214208 00010000:00010000:3.0:1788592811.210684:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 23 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592811.210731:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 93 00000100:00100000:3.0:1788592811.210742:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:2396:x1875475209214208:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592811.210762:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592811.210770:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 23 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.210785:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 23 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.210815:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db598d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3030 expref: 23 pid: 13208 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.210835:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:3.0:1788592811.210841:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.210860:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.210868:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.210905:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592811.210972:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:2396:x1875475209214208:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 230us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592811.210982:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 93 00010000:00010000:1.0:1788592811.211124:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211134:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211149:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211165:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211173:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211179:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592811.211185:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211195:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211205:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:1.0:1788592811.211209:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592811.211213:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211219:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211231:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211237:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211243:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211249:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592811.211258:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211266:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211276:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176700) 00010000:00010000:1.0:1788592811.211279:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592811.211283:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592811.211289:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592811.211716:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12361:x1875475209213824:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 24111us (24297us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788592811.211726:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 201 00000020:00080000:1.0:1788592811.211731:0:10029:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788592811.211983:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592811.211988:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592811.212932:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788592811.212947:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592811.215201:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592811.215279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209214464 00000100:00100000:3.0:1788592811.215291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209214464 00000100:00100000:3.0:1788592811.215354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:3.0:1788592811.215365:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921869699050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12361:x1875475209214464:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788592811.215673:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788592811.215717:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788592811.215756:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.215777:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.215793:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.215817:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.215825:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.215832:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592811.215851:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592811.215874:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592811.215885:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.215894:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592811.215900:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.215910:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.215927:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592811.215930:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592811.215937:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.215944:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592811.215958:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592811.215960:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592811.215969:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592811.216116:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921869699050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:12361:x1875475209214464:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 751us (923us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788592811.216126:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 50 00000020:00080000:3.0:1788592811.216132:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592811.833176:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226038912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592811.833286:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592811.833402:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226039040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592811.833447:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592811.833511:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226038912 00000100:00100000:3.0:1788592811.833521:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226038912 00000100:00100000:2.0:1788592811.833549:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226039040 00000100:00100000:2.0:1788592811.833556:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226039040 00000100:00100000:3.0:1788592811.833585:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788592811.833594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788592811.833598:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226038912:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592811.833609:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226039040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592811.833650:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000004:00000024:3.0:1788592811.833708:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592811.833718:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226039040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592811.833728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788592811.833763:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226038912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592811.833763:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226039040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592811.833770:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788592811.833888:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226038912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788592811.960597:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592812.985513:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592813.012145:0:14694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592813.012159:0:14694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592813.012194:0:14694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:0.0:1788592813.012204:0:14694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592813.099349:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.099497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209214720 00000100:00100000:2.0:1788592813.099509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209214720 00000100:00100000:2.0:1788592813.099616:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 202 00000100:00100000:2.0:1788592813.099630:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:12380:x1875475209214720:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592813.099683:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.099711:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3068 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.100061:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fa00/0xbd314a3362db5a58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.100098:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fa00/0xbd314a3362db5a58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.100113:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fa00/0xbd314a3362db5a58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592813.100125:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788592813.100265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3068 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.100287:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fa00/0xbd314a3362db5a58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3068 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.100299:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592813.100303:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788592813.100307:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820fa00, rc 0) 00000100:00100000:2.0:1788592813.100389:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:12380:x1875475209214720:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 761us (1053us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788592813.100397:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 202 00000100:00080000:3.0:1788592813.100937:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592813.104347:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.105398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209214848 00000100:00100000:2.0:1788592813.105412:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209214848 00000100:00100000:2.0:1788592813.105507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 203 00000100:00100000:2.0:1788592813.105529:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:12380:x1875475209214848:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:2.0:1788592813.105628:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105651:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105666:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105685:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105693:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105701:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105797:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105806:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105813:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592813.105870:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105886:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105901:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105909:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105916:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.105922:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105931:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105946:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592813.105950:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.105957:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105964:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5a66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105977:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105983:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105989:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.105994:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.106006:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106014:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106024:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff92174372d000) 00010000:00010000:2.0:1788592813.106026:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.106029:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106036:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5a6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106054:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106060:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106098:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106104:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ea00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.106108:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106114:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106122:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff92174372d700) 00010000:00010000:2.0:1788592813.106124:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.106136:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.106143:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.106235:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:12380:x1875475209214848:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 708us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.107010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 203 00000100:00100000:0.0:1788592813.138819:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.139045:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209215104 00000100:00100000:3.0:1788592813.139130:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209215104 00000100:00100000:3.0:1788592813.139203:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 204 00000100:00100000:3.0:1788592813.139217:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+25:12383:x1875475209215104:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592813.139245:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592813.139272:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c306f expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139385:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139406:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139423:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139441:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139449:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139456:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.139866:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140014:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140023:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592813.140120:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788592813.140227:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140237:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140246:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140253:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592813.140259:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140268:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140284:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592813.140288:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592813.140295:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140302:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5a82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140317:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140323:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140404:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140410:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592813.140414:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140421:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140430:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176300) 00010000:00010000:3.0:1788592813.140433:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592813.140436:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140443:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140506:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5a7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 28 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140524:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 27 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.140532:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:3.0:1788592813.140534:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592813.140537:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ee00, rc 0) 00000100:00100000:3.0:1788592813.140744:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12383:x1875475209215104:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1529us (1937us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788592813.140763:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 204 00000100:00100000:0.0:1788592813.143425:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.143519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209215232 00000100:00100000:2.0:1788592813.143534:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209215232 00000100:00100000:2.0:1788592813.143621:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 205 00000100:00100000:2.0:1788592813.143636:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12383:x1875475209215232:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:2.0:1788592813.143725:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143748:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143763:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143808:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143816:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143836:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143844:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ea00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.143856:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143866:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143881:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.143884:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592813.143890:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.143897:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.144001:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12383:x1875475209215232:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 368us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.144010:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 205 00000100:00100000:3.0:1788592813.147250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.147497:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209215488 00000100:00100000:2.0:1788592813.147510:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209215488 00000100:00100000:2.0:1788592813.147595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:2.0:1788592813.147609:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12383:x1875475209215488:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592813.147917:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+28:12383:x1875475209215488:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 310us (678us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788592813.147927:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:3.0:1788592813.175571:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.175827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209215744 00000100:00100000:2.0:1788592813.175840:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209215744 00000100:00100000:2.0:1788592813.175912:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 206 00000100:00100000:2.0:1788592813.175926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+28:11907:x1875475209215744:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592813.175961:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.175998:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5aa5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3076 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.176271:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.176291:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 29 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.176301:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.176345:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 29 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.176360:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 29 pid: 10029 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.176376:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226039168:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592813.176495:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22180 going to sleep for 11 seconds 00000100:00100000:3.0:1788592813.180232:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592813.181360:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209215872 00000100:00100000:1.0:1788592813.181374:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209215872 00010000:00010000:1.0:1788592813.181433:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 30 pid: 10029 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592813.181500:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 94 00000100:00100000:1.0:1788592813.181513:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:2395:x1875475209215872:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592813.181542:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592813.181552:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 30 pid: 10029 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.181569:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 30 pid: 10029 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.181599:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:1.0:1788592813.181606:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.181619:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.181629:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.181656:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592813.181732:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:2395:x1875475209215872:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 220us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592813.181741:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 94 00010000:00010000:2.0:1788592813.183345:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5a90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c306f expref: 29 pid: 10029 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.183374:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226039168:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592813.183410:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.183421:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.183439:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592813.183466:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788592813.183647:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5aa5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.183666:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.183676:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.183679:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788592813.183684:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f800, rc 0) 00000100:00100000:2.0:1788592813.183799:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:11907:x1875475209215744:12345-192.168.203.47@tcp:101:bash.0 Request processed in 7875us (8239us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788592813.183810:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 206 00000100:00100000:3.0:1788592813.190310:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592813.190381:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209216000 00000100:00100000:1.0:1788592813.190394:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209216000 00000100:00100000:1.0:1788592813.190461:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 207 00000100:00100000:1.0:1788592813.190484:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:11907:x1875475209216000:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:1.0:1788592813.190514:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592813.190541:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db5aba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c307d expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.190618:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a000/0xbd314a3362db5ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.190637:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a000/0xbd314a3362db5ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.190654:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a000/0xbd314a3362db5ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.190811:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b400/0xbd314a3362db5aba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c307d expref: 31 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.190833:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a000/0xbd314a3362db5ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c307d expref: 30 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.190844:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:1.0:1788592813.190847:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592813.190852:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a000, rc 0) 00000100:00100000:1.0:1788592813.190933:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921876654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11907:x1875475209216000:12345-192.168.203.47@tcp:101:bash.0 Request processed in 461us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592813.190942:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 207 00000100:00100000:0.0:1788592813.193782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.193850:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209216256 00000100:00100000:3.0:1788592813.193865:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209216256 00000100:00100000:3.0:1788592813.193985:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 208 00000100:00100000:3.0:1788592813.193998:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:11907:x1875475209216256:12345-192.168.203.47@tcp:36:bash.0 00010000:00010000:3.0:1788592813.194509:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.194533:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.194548:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592813.194600:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788592813.194627:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057db29ca reply state 0000000087aba6eb transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.194642:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.194651:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:3.0:1788592813.194654:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592813.194660:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788592813.194706:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1788592813.194857:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:11907:x1875475209216256:12345-192.168.203.47@tcp:36:bash.0 Request processed in 858us (1085us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788592813.194865:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 208 00000020:00080000:3.0:1788592813.194871:0:13208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788592813.197287:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.197980:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209216384 00000100:00100000:2.0:1788592813.197993:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209216384 00000100:00100000:2.0:1788592813.198130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 209 00000100:00100000:2.0:1788592813.198143:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+34:11907:x1875475209216384:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592813.198279:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.198307:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5acf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3084 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.198383:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5acf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3084 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.198426:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5acf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3084 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.198450:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.198454:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592813.198458:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820ea00, rc 0) 00000100:00100000:2.0:1788592813.198544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:11907:x1875475209216384:12345-192.168.203.47@tcp:101:bash.0 Request processed in 403us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.198741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 209 00000100:00100000:0.0:1788592813.200897:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.201447:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209216512 00000100:00100000:3.0:1788592813.201460:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209216512 00000100:00100000:3.0:1788592813.201634:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:3.0:1788592813.201647:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:11907:x1875475209216512:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592813.201670:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592813.201696:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c308b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592813.201729:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bc2aa, atime: 0x6a9bc2a8, ctime: 0x6a9bc2aa, blocks: 0x8 00010000:00010000:3.0:1788592813.201760:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1788592813.201765:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592813.201775:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.201794:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.201809:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838800, rc 0) 00000100:00100000:3.0:1788592813.201885:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:11907:x1875475209216512:12345-192.168.203.47@tcp:101:bash.0 Request processed in 240us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.201892:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00080000:2.0:1788592813.201929:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592813.204850:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.204947:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209216640 00000100:00100000:3.0:1788592813.204961:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209216640 00002000:00010000:3.0:1788592813.205173:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788592813.205180:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921743b40700 with x1875475209216640 ext(0->18446744073709551615) 00002000:00010000:3.0:1788592813.205196:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921743b40700. 00000100:00100000:3.0:1788592813.205226:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:3.0:1788592813.205237:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209216640:12345-192.168.203.47@tcp:10:bash.0 00002000:00010000:3.0:1788592813.205563:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788592813.205568:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788592810 -> 1788592813 00002000:00010000:3.0:1788592813.205571:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788592808 -> 1788592808 00002000:00010000:3.0:1788592813.205573:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788592810 -> 1788592813 00002000:00010000:3.0:1788592813.205575:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788592813.205694:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209216640:12345-192.168.203.47@tcp:10:bash.0 Request processed in 457us (856us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788592813.205703:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00002000:00010000:3.0:1788592813.205708:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788592813.205711:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921743b40700 with x1875475209216640 ext(0->18446744073709551615) 00002000:00010000:3.0:1788592813.205716:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921743b40700. 00000100:00100000:1.0:1788592813.284608:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.285543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209216768 00000100:00100000:2.0:1788592813.285560:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209216768 00000100:00100000:2.0:1788592813.285649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 210 00000100:00100000:2.0:1788592813.285661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:12397:x1875475209216768:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:2.0:1788592813.285764:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285787:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285802:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285820:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285827:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285857:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285948:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285958:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.285966:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592813.286021:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286034:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286041:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286047:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286053:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.286058:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286093:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286109:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592813.286120:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.286127:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5add lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286150:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286156:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286163:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286169:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.286172:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286177:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286185:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff92174372d700) 00010000:00010000:2.0:1788592813.286188:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.286191:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286197:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f600/0xbd314a3362db5ae4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286220:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286233:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286239:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286245:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.286248:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286254:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286263:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.286266:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.286269:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.286275:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5aeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.286579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:12397:x1875475209216768:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 917us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.286590:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 210 00000100:00100000:0.0:1788592813.324189:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.325227:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209217024 00000100:00100000:3.0:1788592813.325242:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209217024 00000100:00100000:3.0:1788592813.325324:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 211 00000100:00100000:3.0:1788592813.325334:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+35:12400:x1875475209217024:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592813.325360:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592813.325390:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5af2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3092 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325496:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325534:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325548:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325566:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325574:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325581:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325718:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325727:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325734:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592813.325745:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788592813.325839:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325847:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325853:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325864:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592813.325869:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325877:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325890:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592813.325892:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592813.325898:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325905:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5af9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325930:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325936:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325942:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325947:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592813.325950:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325956:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325973:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:3.0:1788592813.325975:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592813.325978:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.325991:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.326036:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5af2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3092 expref: 38 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.326050:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3092 expref: 37 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.326058:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:3.0:1788592813.326061:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788592813.326063:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e600, rc 0) 00000100:00100000:3.0:1788592813.326211:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12400:x1875475209217024:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 878us (2037us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788592813.326219:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 211 00000100:00100000:0.0:1788592813.331308:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.331384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209217152 00000100:00100000:2.0:1788592813.331397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209217152 00000100:00100000:2.0:1788592813.331483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 212 00000100:00100000:2.0:1788592813.331497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12400:x1875475209217152:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:2.0:1788592813.331590:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.331629:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.331641:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.331692:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.331710:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 37 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.331728:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226039296:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592813.331832:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22180 going to sleep for 11 seconds 00000100:00100000:0.0:1788592813.338808:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.338922:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1875475226039296:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592813.338947:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209217408 00000100:00100000:1.0:1788592813.338956:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209217408 00010000:00010000:2.0:1788592813.338963:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592813.339037:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:1.0:1788592813.339517:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:6631:x1875475209217408:12345-192.168.203.47@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788592813.339896:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:6631:x1875475209217408:12345-192.168.203.47@tcp:35:ldlm_bl.0 Request processed in 388us (1102us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788592813.340454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:2.0:1788592813.343921:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592813.344181:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209217536 00000100:00100000:0.0:1788592813.344193:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209217536 00010000:00010000:0.0:1788592813.344241:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 39 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592813.344283:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 95 00000100:00100000:0.0:1788592813.344299:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:2395:x1875475209217536:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592813.344319:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592813.344327:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 39 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.344365:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 39 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.344405:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f800/0xbd314a3362db5aac lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3076 expref: 39 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.344426:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:0.0:1788592813.344432:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.344444:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.344453:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.344720:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592813.344740:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.344752:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592813.344793:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:2395:x1875475209217536:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 494us (893us total) trans 0 rc 0/0 00010000:00010000:2.0:1788592813.344798:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592813.344809:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 95 00010000:00010000:2.0:1788592813.344821:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.344829:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.344835:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.344909:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.344920:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.345054:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.345057:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592813.345062:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.345095:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.345146:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12400:x1875475209217152:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 13652us (13851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.345157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 212 00000100:00100000:0.0:1788592813.348304:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.348855:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209217792 00000100:00100000:3.0:1788592813.348869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209217792 00000100:00100000:3.0:1788592813.348943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:3.0:1788592813.348953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+37:12400:x1875475209217792:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1788592813.349242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:12400:x1875475209217792:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 290us (953us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788592813.349247:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:1.0:1788592813.437626:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.437780:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209218048 00000100:00100000:2.0:1788592813.437793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209218048 00000100:00100000:2.0:1788592813.437875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 213 00000100:00100000:2.0:1788592813.437889:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+38:12411:x1875475209218048:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:2.0:1788592813.437920:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.437963:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3099 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438063:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438115:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438129:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438148:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438155:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438161:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438296:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5b31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438307:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438315:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592813.438327:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788592813.438424:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438444:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438451:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438458:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.438464:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438483:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438499:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592813.438503:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.438510:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438516:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438532:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438539:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438546:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438551:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820fc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.438560:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438567:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438574:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff92174372d700) 00010000:00010000:2.0:1788592813.438577:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.438580:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438586:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438633:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3099 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438647:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3099 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.438654:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.438656:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592813.438659:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e600, rc 0) 00000100:00100000:2.0:1788592813.438805:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12411:x1875475209218048:12345-192.168.203.47@tcp:101:cat.0 Request processed in 919us (1195us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788592813.438814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 213 00000100:00100000:2.0:1788592813.443055:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592813.443221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209218304 00000100:00100000:1.0:1788592813.443236:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209218304 00000100:00100000:1.0:1788592813.443304:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:1.0:1788592813.443317:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+40:12411:x1875475209218304:12345-192.168.203.47@tcp:35:cat.0 00000100:00100000:1.0:1788592813.443759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+41:12411:x1875475209218304:12345-192.168.203.47@tcp:35:cat.0 Request processed in 444us (718us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788592813.443768:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:1.0:1788592813.462426:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.462649:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209218560 00000100:00100000:3.0:1788592813.462662:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209218560 00000100:00100000:3.0:1788592813.462739:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 214 00000100:00100000:3.0:1788592813.462750:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+41:12412:x1875475209218560:12345-192.168.203.47@tcp:36:rm.0 00010000:00010000:3.0:1788592813.462834:0:10029:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788592813.462867:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5acf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3084 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.462893:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5b31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3099 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.462906:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3092 expref: 39 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.462937:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a000/0xbd314a3362db5ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c307d expref: 38 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.462957:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:3.0:1788592813.462964:0:10029:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592813.462991:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463016:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463030:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463202:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463229:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463236:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463327:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463441:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.463449:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592813.464279:0:10029:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788592813.465935:0:10029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347712863527ns, next at 348711220919ns, rc = 0 00010000:00010000:2.0:1788592813.466078:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466119:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466135:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466146:0:10029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466154:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466161:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466189:0:10029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592813.466223:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466231:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466238:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466245:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.466250:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466259:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466286:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:2.0:1788592813.466302:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788592813.466309:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466316:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b4d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466339:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466346:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466351:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466366:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.466369:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466376:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466385:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592813.466388:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.466391:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466397:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592813.466422:0:10029:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee5a977c reply state 0000000021bb3eae transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466435:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.466442:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:2.0:1788592813.466445:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592813.466448:0:10029:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592813.466573:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:12412:x1875475209218560:12345-192.168.203.47@tcp:36:rm.0 Request processed in 3819us (4156us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788592813.466583:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 214 00010000:00010000:0.0:1788592813.467577:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592813.467589:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.467597:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592813.467601:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.467624:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.467638:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:0.0:1788592813.467641:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592813.467646:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.467652:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5b54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.467666:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592813.467668:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592813.467669:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592813.515250:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.516788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209218816 00000100:00100000:2.0:1788592813.516808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209218816 00000100:00100000:2.0:1788592813.516892:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 215 00000100:00100000:2.0:1788592813.516905:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+39:12418:x1875475209218816:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592813.517159:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.517205:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.518736:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.518764:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.518778:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.518812:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.518821:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.518828:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592813.519748:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788592813.519926:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.519940:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.519949:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.519991:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.519998:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520005:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520011:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592813.520016:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520038:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520054:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:2.0:1788592813.520057:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592813.520062:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520095:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5b62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592813.520111:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1ca9b1e reply state 000000008e57edfd transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520123:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520129:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:2.0:1788592813.520131:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788592813.520135:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788592813.520178:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520196:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.520205:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:2.0:1788592813.520207:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592813.520210:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e200, rc 0) 00000100:00100000:2.0:1788592813.521552:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:12418:x1875475209218816:12345-192.168.203.47@tcp:101:bash.0 Request processed in 4636us (6304us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788592813.521580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 215 00000100:00100000:3.0:1788592813.527990:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.528215:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209218944 00000100:00100000:2.0:1788592813.528230:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209218944 00000100:00100000:2.0:1788592813.528327:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:2.0:1788592813.528340:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209218944:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:2.0:1788592813.528363:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.528393:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30a7 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592813.528424:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592813.528449:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1788592813.528453:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592813.528464:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.528501:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.528519:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820fc00, rc 0) 00000100:00100000:2.0:1788592813.528598:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209218944:12345-192.168.203.47@tcp:101:bash.0 Request processed in 261us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.528608:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00080000:3.0:1788592813.529088:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592813.531557:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.531733:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209219072 00000100:00100000:3.0:1788592813.531746:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209219072 00000100:00100000:3.0:1788592813.531874:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:3.0:1788592813.531888:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:12418:x1875475209219072:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592813.531912:0:8590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592813.531944:0:8590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30ae expref: -99 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.531985:0:8590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.531995:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592813.532017:0:8590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592813.532024:0:8590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 9 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.532111:0:8590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.532133:0:8590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592813.532150:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226039424:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592813.532277:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592813.535196:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.535352:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8590:1875475226039424:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592813.535388:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209219200 00010000:00010000:3.0:1788592813.535397:0:8590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 9 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.535400:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209219200 00010000:00010000:3.0:1788592813.535426:0:8590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839a00, rc 0) 00000100:00100000:3.0:1788592813.535506:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:12418:x1875475209219072:12345-192.168.203.47@tcp:101:bash.0 Request processed in 3621us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.535517:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00010000:00010000:2.0:1788592813.535673:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.535743:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:2.0:1788592813.535891:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209219200:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592813.535909:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592813.535936:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.535951:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.535992:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687c44e3/0xbd314a3362db5b7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a7 expref: 9 pid: 8428 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.536009:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592813.536013:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592813.536023:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.536035:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.536115:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.536132:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217445bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10331:1875475226039552:192.168.203.47@tcp:105: 00000100:00100000:2.0:1788592813.536226:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592813.539340:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217445bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10331:1875475226039552:192.168.203.47@tcp:105: 00010000:00010000:2.0:1788592813.539383:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592813.540550:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209219200:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 4786us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.540566:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 96 00000100:00100000:1.0:1788592813.541933:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.542087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209219456 00000100:00100000:3.0:1788592813.542100:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209219456 00000100:00100000:3.0:1788592813.542163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:3.0:1788592813.542191:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+42:12418:x1875475209219456:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:3.0:1788592813.542591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+43:12418:x1875475209219456:12345-192.168.203.47@tcp:35:bash.0 Request processed in 401us (667us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788592813.542599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:1.0:1788592813.660314:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.666873:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209219584 00000100:00100000:3.0:1788592813.666894:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209219584 00000100:00100000:3.0:1788592813.667256:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 216 00000100:00100000:3.0:1788592813.667270:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+43:12434:x1875475209219584:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592813.667304:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592813.667333:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30b5 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.667432:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.667451:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.667465:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592813.667528:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788592813.667533:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592813.667557:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.667587:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30b5 expref: 45 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.667635:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30b5 expref: 44 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.667645:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592813.667648:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592813.667653:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f400, rc 0) 00000100:00100000:3.0:1788592813.669304:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+44:12434:x1875475209219584:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 2022us (8989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.669318:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 216 00000100:00100000:0.0:1788592813.674578:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.674757:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209219840 00000100:00100000:2.0:1788592813.674770:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209219840 00000100:00100000:2.0:1788592813.674843:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 217 00000100:00100000:2.0:1788592813.674854:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+44:12434:x1875475209219840:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592813.674881:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.674906:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30bc expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.675620:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5ba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.675643:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.675657:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592813.675671:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788592813.675925:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fc00/0xbd314a3362db5b9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30bc expref: 47 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.675948:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30bc expref: 46 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.675957:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:2.0:1788592813.675978:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592813.676053:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e000, rc 0) 00000100:00100000:2.0:1788592813.676378:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:12434:x1875475209219840:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1524us (1812us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788592813.676396:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 217 00000100:00100000:0.0:1788592813.679611:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592813.679801:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220096 00000100:00100000:2.0:1788592813.679814:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220096 00000100:00100000:2.0:1788592813.679894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 218 00000100:00100000:2.0:1788592813.679904:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+46:12434:x1875475209220096:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592813.679936:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592813.679963:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5baf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30c3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.680917:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5bb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.680943:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.680958:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592813.680973:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788592813.681465:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f000/0xbd314a3362db5baf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30c3 expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.681503:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30c3 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.681539:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:2.0:1788592813.681542:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788592813.681547:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820fe00, rc 0) 00000100:00100000:2.0:1788592813.681635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+48:12434:x1875475209220096:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1732us (2038us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788592813.681646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 218 00000100:00100000:1.0:1788592813.684041:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.685095:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220224 00000100:00100000:3.0:1788592813.685107:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220224 00000100:00100000:3.0:1788592813.685233:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:3.0:1788592813.685244:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+48:2396:x1875475209220224:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592813.685270:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592813.685307:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5ba1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30bc expref: 48 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.685329:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:3.0:1788592813.685335:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592813.685406:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:2396:x1875475209220224:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 164us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.685413:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:0.0:1788592813.688595:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.688676:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220352 00000100:00100000:3.0:1788592813.688685:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220352 00000100:00100000:3.0:1788592813.688746:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:3.0:1788592813.688770:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209220352:12345-192.168.203.47@tcp:1:lfs.0 00010000:00010000:3.0:1788592813.688811:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.688831:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.688840:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592813.688844:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592813.688849:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.688895:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 8 pid: 8590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.688909:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 8 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592813.688922:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1875475226039680:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592813.690133:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592813.697374:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1875475226039680:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592813.697408:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592813.698118:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.698275:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220480 00000100:00100000:3.0:1788592813.698282:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220480 00002000:00100000:3.0:1788592813.698336:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff921744464380 x1875475209220480/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:89/0 lens 504/0 e 0 to 0 dl 1788592824 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788592813.698348:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744464380 with x1875475209220480 ext(0->8) 00010000:00010000:3.0:1788592813.698356:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 9 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.698370:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 9 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592813.698378:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff921744464380 00000100:00100000:3.0:1788592813.698413:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:3.0:1788592813.698424:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2394:x1875475209220480:12345-192.168.203.47@tcp:4:lfs.0 00000100:00100000:2.0:1788592813.699611:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2394:x1875475209220480:12345-192.168.203.47@tcp:4:lfs.0 Request processed in 1185us (1491us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788592813.699626:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00002000:00100000:2.0:1788592813.699634:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff921744464380 x1875475209220480/t4294967309(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:89/0 lens 504/448 e 0 to 0 dl 1788592824 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592813.700432:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744464380 with x1875475209220480 ext(0->8) 00010000:00010000:2.0:1788592813.700444:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 11 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.700460:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 11 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592813.700467:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff921744464380 00000100:00100000:1.0:1788592813.702390:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.702466:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220608 00000100:00100000:3.0:1788592813.702485:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220608 00010000:00010000:3.0:1788592813.702525:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 11 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592813.702617:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 97 00000100:00100000:3.0:1788592813.702628:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2394:x1875475209220608:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592813.702651:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788592813.702676:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788592813.702679:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788592813 00002000:00010000:3.0:1788592813.702682:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788592813 00002000:00010000:3.0:1788592813.702684:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788592813 00002000:00010000:3.0:1788592813.702687:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788592813.702694:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 11 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.702719:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 11 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.702744:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6be5a1/0xbd314a3362db5b85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ae expref: 11 pid: 8590 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.702762:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592813.702766:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592813.702771:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.702781:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.702811:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592813.702867:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2394:x1875475209220608:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 240us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.702874:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 97 00010000:00010000:2.0:1788592813.703418:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703429:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703463:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703487:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703495:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703503:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592813.703507:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703516:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703530:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592813.703537:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003031ef2e/0xbd314a3362db5bc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592813.703592:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2395:x1875475209220352:12345-192.168.203.47@tcp:1:lfs.0 Request processed in 14823us (15004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.703600:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 70 00000100:00100000:1.0:1788592813.707426:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.707510:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220864 00000100:00100000:3.0:1788592813.707519:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220864 00000100:00100000:3.0:1788592813.707608:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:3.0:1788592813.707617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186969ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+47:12434:x1875475209220864:12345-192.168.203.47@tcp:35:lfs.0 00000004:00010000:3.0:1788592813.707676:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30c3 expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592813.707882:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788592813.707915:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788592813.708751:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1788592813.708793:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.708809:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.708818:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.708848:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.708864:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 51 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592813.708877:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1875475226039808:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592813.708954:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592813.712854:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1875475226039808:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592813.712885:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592813.716435:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592813.716537:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209220992 00000100:00100000:0.0:1788592813.716547:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209220992 00010000:00010000:0.0:1788592813.716598:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 52 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592813.716636:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 98 00000100:00100000:0.0:1788592813.716646:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+52:2395:x1875475209220992:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592813.716665:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592813.716782:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 52 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.716801:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 52 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.716826:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5b70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30a0 expref: 52 pid: 6514 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.716840:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:0.0:1788592813.716847:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.716856:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.716863:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.716915:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592813.716964:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+51:2395:x1875475209220992:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 320us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.716971:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 98 00010000:00010000:3.0:1788592813.718661:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.718677:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592813.718890:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788592813.719410:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788592813.719519:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744466300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226039936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592813.720954:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.720999:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592813.721177:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226039936 00000100:00100000:2.0:1788592813.721185:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226039936 00000100:00100000:2.0:1788592813.721270:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788592813.721280:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1875475226039936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592813.721384:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1875475226039936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.721392:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788592813.721557:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592813.722329:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744466300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226039936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788592813.722484:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788592813.722558:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226040064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788592813.722607:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592813.722641:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592813.722939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040064 00000100:00100000:3.0:1788592813.722945:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040064 00000100:00100000:3.0:1788592813.722998:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788592813.723007:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1875475226040064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788592813.723156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6516:x1875475226040064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 150us (548us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788592813.723164:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788592813.723415:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1875475226040064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788592813.723461:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788592813.723511:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.723533:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.723541:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.723547:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592813.723551:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.723560:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.723575:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:1.0:1788592813.723578:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788592813.723583:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.723590:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592813.723686:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788592813.723745:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788592813.723757:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347970689193ns, next at 348970686964ns, rc = 0 00000001:00080000:1.0:1788592813.723763:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788592813.723786:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff92174372d700) 00010000:00010000:1.0:1788592813.723789:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788592813.723795:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fe00/0xbd314a3362db5bb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30c3 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592813.723912:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186969ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:12434:x1875475209220864:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 16295us (16493us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788592813.723921:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000020:00080000:1.0:1788592813.723925:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788592813.727733:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592813.729405:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209221120 00000100:00100000:0.0:1788592813.729419:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209221120 00000100:00100000:0.0:1788592813.729499:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 219 00000100:00100000:0.0:1788592813.729509:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+54:12434:x1875475209221120:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592813.729530:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592813.729550:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5bd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30ca expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.729604:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ca expref: 55 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.729619:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ca expref: 55 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.729639:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592813.729642:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592813.729646:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0800, rc 0) 00000100:00100000:0.0:1788592813.729766:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:12434:x1875475209221120:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 257us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.729772:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 219 00000100:00100000:0.0:1788592813.733779:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592813.733986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209221376 00000100:00100000:1.0:1788592813.733996:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209221376 00000100:00100000:1.0:1788592813.734052:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:1.0:1788592813.734061:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+55:12434:x1875475209221376:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:1.0:1788592813.734320:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12434:x1875475209221376:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 259us (549us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788592813.734328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:2.0:1788592813.840893:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592813.841006:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209221504 00000100:00100000:1.0:1788592813.841024:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209221504 00000100:00100000:1.0:1788592813.841134:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 220 00000100:00100000:1.0:1788592813.841146:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12444:x1875475209221504:12345-192.168.203.47@tcp:34:lfs.0 00010000:00010000:1.0:1788592813.841224:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841243:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841255:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841267:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841291:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841299:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841376:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841385:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841392:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592813.841441:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841455:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841462:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841480:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841487:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022ba00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592813.841492:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841500:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841521:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592813.841524:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592813.841529:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841535:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5bd9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841551:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841557:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841563:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841568:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592813.841570:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841576:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841582:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:1.0:1788592813.841585:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592813.841587:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841592:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5be0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841613:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841619:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841625:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841630:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592813.841633:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841638:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841645:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592813.841648:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592813.841650:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592813.841655:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5be7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592813.841737:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12444:x1875475209221504:12345-192.168.203.47@tcp:34:lfs.0 Request processed in 593us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592813.841745:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 220 00000100:00100000:3.0:1788592813.880512:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226040448:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592813.880631:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226040960:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880657:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592813.880675:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226041472:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880698:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592813.880722:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788592813.880728:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226040320:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592813.880791:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226040832:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880812:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592813.880827:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226041344:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880844:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592813.880874:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040448 00000100:00100000:3.0:1788592813.880882:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040448 00000100:00100000:3.0:1788592813.880929:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788592813.880936:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226040448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.880983:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226040448:12345-0@lo:400:kworker.0 Request processed in 47us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.880990:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788592813.881010:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040960 00000100:00100000:3.0:1788592813.881013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040960 00000100:00100000:3.0:1788592813.881035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041472 00000100:00100000:3.0:1788592813.881037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041472 00000100:00100000:3.0:1788592813.881063:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040320 00000100:00100000:3.0:1788592813.881098:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040320 00000100:00100000:3.0:1788592813.881109:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040832 00000100:00100000:3.0:1788592813.881111:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040832 00000100:00100000:3.0:1788592813.881121:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041344 00000100:00100000:3.0:1788592813.881122:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041344 00000100:00100000:3.0:1788592813.881133:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788592813.881138:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226040960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881165:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226040960:12345-0@lo:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.881172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788592813.881182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788592813.881187:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226041472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881207:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226041472:12345-0@lo:400:kworker.0 Request processed in 21us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.881213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788592813.881223:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788592813.881227:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226040320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881252:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226040320:12345-0@lo:400:kworker.0 Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.881264:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788592813.881277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788592813.881282:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226040832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881308:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226040832:12345-0@lo:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.881314:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788592813.881324:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788592813.881329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226041344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881352:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226041344:12345-0@lo:400:kworker.0 Request processed in 23us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.881357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1788592813.881373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592813.881377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592813.881409:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226040320:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881420:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226040832:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881428:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226041344:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.881436:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226040448:0@lo:400:kworker.0 00010000:00080000:3.0:1788592813.881447:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217444c1880 x1875475226040960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592813.881457:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226040960:0@lo:400:kworker.0 00010000:00080000:3.0:1788592813.881466:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217444c1500 x1875475226041472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592813.881485:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226041472:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881601:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226040576:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881631:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881657:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226041088:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881677:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881694:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226041600:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881724:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788592813.881735:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226040192:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881761:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881786:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226040704:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881807:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881823:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226041216:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881843:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881860:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226041728:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.881880:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592813.881907:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041088 00000100:00100000:0.0:1788592813.881911:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041088 00000100:00100000:0.0:1788592813.881945:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041600 00000100:00100000:0.0:1788592813.881948:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041600 00000100:00100000:0.0:1788592813.881960:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041216 00000100:00100000:0.0:1788592813.881962:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041216 00000100:00100000:0.0:1788592813.881971:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041728 00000100:00100000:0.0:1788592813.881973:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041728 00000100:00100000:0.0:1788592813.881991:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788592813.881997:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226041088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882033:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226041088:12345-0@lo:400:kworker.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.882039:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788592813.882050:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788592813.882056:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882103:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226041600:12345-0@lo:400:kworker.0 Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.882109:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788592813.882119:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788592813.882132:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3639:x1875475226041216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882158:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3639:x1875475226041216:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.882164:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788592813.882174:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788592813.882180:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226041728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882202:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226041728:12345-0@lo:400:kworker.0 Request processed in 22us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.882207:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788592813.882221:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592813.882224:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592813.882249:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226041216:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226041728:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882266:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226041088:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882274:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226041600:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040704 00000100:00100000:0.0:1788592813.882299:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040704 00000100:00100000:0.0:1788592813.882320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788592813.882327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226040704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.882357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226040704:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.882363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788592813.882386:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226040704:0@lo:400:kworker.0 00000100:00100000:2.0:1788592813.882714:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040192 00000100:00100000:2.0:1788592813.882718:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040192 00000100:00100000:2.0:1788592813.882747:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788592813.882754:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226040192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592813.882795:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226040192:12345-0@lo:400:kworker.0 Request processed in 42us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592813.882802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788592813.882836:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226040192:0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.882916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226040576 00000100:00100000:3.0:1788592813.882921:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226040576 00000100:00100000:3.0:1788592813.882955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788592813.882961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226040576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592813.882998:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226040576:12345-0@lo:400:kworker.0 Request processed in 37us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592813.883004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788592813.883294:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592813.883306:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592813.883341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592813.883443:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226040576:0@lo:400:kworker.0 00000100:00100000:0.0:1788592813.883540:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226041856 00000100:00100000:0.0:1788592813.883550:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226041856 00000100:00100000:0.0:1788592813.883582:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788592813.883589:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226041856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592813.883620:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788592813.883659:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226041856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.883665:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788592813.883775:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592813.913097:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592813.913231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209221760 00000100:00100000:3.0:1788592813.913240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209221760 00000100:00100000:3.0:1788592813.913297:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 221 00000100:00100000:3.0:1788592813.913307:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+56:12447:x1875475209221760:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592813.913327:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592813.913348:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5bee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913419:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913434:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913446:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913456:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913463:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913497:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913679:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913688:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913695:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592813.913704:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788592813.913773:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913781:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913788:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913794:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592813.913798:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913805:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913817:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592813.913821:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592813.913832:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913839:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5bf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913852:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913859:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913865:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913870:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592813.913874:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913879:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913886:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:3.0:1788592813.913888:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592813.913890:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913895:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5bfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913929:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5bee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913954:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592813.913961:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592813.913963:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592813.913965:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841494200, rc 0) 00000100:00100000:3.0:1788592813.914251:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:12447:x1875475209221760:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 944us (1189us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788592813.914259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 221 00000100:00100000:2.0:1788592813.920655:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592813.920741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209221888 00000100:00100000:0.0:1788592813.920751:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209221888 00000100:00100000:0.0:1788592813.920811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 222 00000100:00100000:0.0:1788592813.920822:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:12447:x1875475209221888:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:0.0:1788592813.920892:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920908:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920920:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920954:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920961:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920967:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920973:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592813.920991:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.920999:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.921013:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592813.921016:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592813.921021:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592813.921028:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592813.921378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:12447:x1875475209221888:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 557us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592813.921388:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 222 00000100:00100000:2.0:1788592813.924497:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592813.924653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209222144 00000100:00100000:0.0:1788592813.924663:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209222144 00000100:00100000:0.0:1788592813.924751:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:0.0:1788592813.924759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+58:12447:x1875475209222144:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:0.0:1788592813.924987:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12447:x1875475209222144:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 226us (496us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788592813.924994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00010000:00010000:1.0:1788592814.008838:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592814.014190:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.014456:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209222400 00000100:00100000:1.0:1788592814.014465:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209222400 00000100:00100000:1.0:1788592814.014553:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 223 00000100:00100000:1.0:1788592814.014564:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12457:x1875475209222400:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:1.0:1788592814.014589:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592814.014592:0:10029:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788592814.014621:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5b93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30b5 expref: 59 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.014641:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592814.014647:0:10029:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592814.014660:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30d8 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.014780:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.014795:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.014805:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.014840:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.014855:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 59 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.014884:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226041984:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592814.014972:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.020487:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226041984:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592814.020517:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.021937:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.023651:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209222528 00000100:00100000:0.0:1788592814.023786:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209222528 00010000:00010000:0.0:1788592814.023835:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 60 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.024158:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 99 00000100:00100000:0.0:1788592814.024186:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:2396:x1875475209222528:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592814.024211:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592814.024219:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 60 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.024234:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 60 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.024257:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d1 expref: 60 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.024274:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.024279:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.024290:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.024298:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.024331:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592814.024405:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:2396:x1875475209222528:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 222us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.024413:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 99 00010000:00010000:1.0:1788592814.024493:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.024503:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592814.024523:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788592814.024681:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 60 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.024710:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 59 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.024719:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592814.024721:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592814.024724:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b200, rc 0) 00000100:00100000:1.0:1788592814.024750:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12457:x1875475209222400:12345-192.168.203.47@tcp:101:bash.0 Request processed in 10189us (10570us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788592814.024757:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 223 00000100:00100000:2.0:1788592814.030325:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.030419:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209222656 00000100:00100000:3.0:1788592814.030429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209222656 00000100:00100000:3.0:1788592814.030497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 224 00000100:00100000:3.0:1788592814.030508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+59:12457:x1875475209222656:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592814.030529:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592814.030568:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.030608:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.030623:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.030639:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.030752:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.030776:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.030783:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592814.030787:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788592814.030790:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839a00, rc 0) 00000100:00100000:3.0:1788592814.030903:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:12457:x1875475209222656:12345-192.168.203.47@tcp:101:bash.0 Request processed in 395us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.030910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 224 00000100:00100000:2.0:1788592814.037361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.037406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209222912 00000100:00100000:0.0:1788592814.037417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209222912 00000100:00100000:0.0:1788592814.037489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 225 00000100:00100000:0.0:1788592814.037501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+60:12457:x1875475209222912:12345-192.168.203.47@tcp:36:bash.0 00010000:00010000:0.0:1788592814.037749:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.037766:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.037778:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592814.037820:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788592814.037855:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006abe3902 reply state 000000000b815b40 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.037867:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.037874:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.037877:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592814.037880:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592814.038412:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12457:x1875475209222912:12345-192.168.203.47@tcp:36:bash.0 Request processed in 910us (1057us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788592814.038421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 225 00000020:00080000:0.0:1788592814.038426:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788592814.041730:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.041802:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209223040 00000100:00100000:1.0:1788592814.041824:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209223040 00000100:00100000:1.0:1788592814.041930:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 226 00000100:00100000:1.0:1788592814.041941:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12457:x1875475209223040:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:1.0:1788592814.041970:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592814.041991:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30e6 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.042135:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.042151:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 64 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.042161:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.042200:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 64 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.042213:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 64 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.042227:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226042112:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592814.042313:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.044637:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226042112:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592814.044664:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.048495:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.048697:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209223168 00000100:00100000:3.0:1788592814.048706:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209223168 00010000:00010000:3.0:1788592814.048747:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 65 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.048796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 100 00000100:00100000:3.0:1788592814.048805:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:2395:x1875475209223168:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592814.048823:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592814.048830:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 65 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.048844:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 65 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.048868:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b200/0xbd314a3362db5c1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30d8 expref: 65 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.048904:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592814.048922:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.048933:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.048941:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.048991:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592814.049061:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+64:2395:x1875475209223168:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 257us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.049115:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 100 00010000:00010000:1.0:1788592814.049403:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.049412:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592814.049479:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788592814.049484:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592814.049509:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.049539:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 64 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.049555:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 63 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.049564:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592814.049566:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592814.049569:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022ba00, rc 0) 00000100:00100000:1.0:1788592814.049599:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12457:x1875475209223040:12345-192.168.203.47@tcp:101:bash.0 Request processed in 7660us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.049607:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 226 00000100:00100000:3.0:1788592814.053991:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.054119:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209223424 00000100:00100000:1.0:1788592814.054132:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209223424 00000100:00100000:1.0:1788592814.054183:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1788592814.054194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+63:12457:x1875475209223424:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:1.0:1788592814.054446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+64:12457:x1875475209223424:12345-192.168.203.47@tcp:35:bash.0 Request processed in 252us (467us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788592814.054480:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:2.0:1788592814.107149:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.107363:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209223552 00000100:00100000:3.0:1788592814.107373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209223552 00000100:00100000:3.0:1788592814.107437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 227 00000100:00100000:3.0:1788592814.107447:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+64:12463:x1875475209223552:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592814.107481:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592814.107504:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.107571:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5c57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.107585:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.107608:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592814.107657:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788592814.107661:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592814.107683:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.107709:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494200/0xbd314a3362db5c50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ed expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.107728:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5c57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ed expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.107735:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592814.107738:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592814.107741:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f400, rc 0) 00000100:00100000:3.0:1788592814.107806:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12463:x1875475209223552:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 360us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.107814:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 227 00000100:00100000:2.0:1788592814.112309:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.112479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209223680 00000100:00100000:0.0:1788592814.112489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209223680 00000100:00100000:0.0:1788592814.112550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 228 00000100:00100000:0.0:1788592814.112559:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217445bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12463:x1875475209223680:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592814.112580:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592814.112602:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112703:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112721:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112732:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112743:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112749:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112755:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112831:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112840:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112847:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592814.112889:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788592814.112893:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592814.112926:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112955:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112963:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112969:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112975:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112981:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.112984:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.112992:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113004:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592814.113007:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.113012:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113018:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5c65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113030:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113584:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113601:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113606:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.113610:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113616:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113626:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:0.0:1788592814.113628:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.113632:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113638:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113670:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113685:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.113693:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.113695:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592814.113697:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0400, rc 0) 00000100:00100000:0.0:1788592814.113764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217445bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12463:x1875475209223680:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1206us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.113782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 228 00000100:00100000:2.0:1788592814.117537:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.117623:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209223936 00000100:00100000:1.0:1788592814.117633:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209223936 00000100:00100000:1.0:1788592814.117691:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 229 00000100:00100000:1.0:1788592814.117702:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12463:x1875475209223936:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1788592814.117721:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592814.117740:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c30fb expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.117846:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.117861:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 67 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.117870:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.117878:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.117909:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.118181:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 67 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.118196:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226042240:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592814.118291:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 67 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.118300:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 67 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.118309:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226042368:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592814.118331:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184546a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.123278:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226042240:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592814.123295:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226042368:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592814.123323:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.123424:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.124003:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224192 00000100:00100000:3.0:1788592814.124012:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224192 00010000:00010000:3.0:1788592814.124060:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 68 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.124121:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:3.0:1788592814.124130:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffd8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:2393:x1875475209224192:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592814.124160:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592814.124167:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 68 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.124179:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 68 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.124201:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0400/0xbd314a3362db5c73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30f4 expref: 68 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.124217:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592814.124222:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.124236:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.124243:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592814.124298:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffd8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:2393:x1875475209224192:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 168us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.124306:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 101 00000100:00100000:2.0:1788592814.125914:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.125956:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.126320:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224064 00000100:00100000:0.0:1788592814.126329:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224064 00000100:00100000:0.0:1788592814.126419:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224320 00000100:00100000:0.0:1788592814.126424:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224320 00010000:00010000:0.0:1788592814.126441:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 68 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.126485:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 102 00000100:00100000:0.0:1788592814.126494:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:2395:x1875475209224320:12345-192.168.203.47@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788592814.126498:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:3.0:1788592814.126506:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:2395:x1875475209224064:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592814.126508:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592814.126513:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592814.126514:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 68 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.126516:0:6499:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie bd314a3362db5c73) 00010000:00010000:3.0:1788592814.126518:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592814.126527:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 68 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.126547:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022ba00/0xbd314a3362db5c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30e6 expref: 68 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.126559:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:2395:x1875475209224064:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 54us (654us total) trans 0 rc 116/116 00000100:00100000:3.0:1788592814.126659:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00010000:00010000:0.0:1788592814.126677:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.126682:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.126693:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.126702:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.126740:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592814.126767:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:2395:x1875475209224320:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 273us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.126774:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 102 00010000:00010000:1.0:1788592814.126842:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.126851:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592814.126872:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788592814.127194:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 67 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.127211:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 66 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.127218:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592814.127228:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592814.127231:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a200, rc 0) 00000100:00100000:1.0:1788592814.127256:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12463:x1875475209223936:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 9557us (9728us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788592814.127264:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 229 00000100:00100000:2.0:1788592814.130770:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.131300:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224576 00000100:00100000:3.0:1788592814.131309:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224576 00000100:00100000:3.0:1788592814.131640:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:3.0:1788592814.131652:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12463:x1875475209224576:12345-192.168.203.47@tcp:103:lfs.0 00010000:00010000:3.0:1788592814.131670:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592814.131697:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0800/0xbd314a3362db5bd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ca expref: 66 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.131715:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592814.131720:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592814.131781:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12463:x1875475209224576:12345-192.168.203.47@tcp:103:lfs.0 Request processed in 131us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.131788:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:2.0:1788592814.138742:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.138823:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224704 00000100:00100000:1.0:1788592814.138833:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224704 00000100:00100000:1.0:1788592814.138898:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 230 00000100:00100000:1.0:1788592814.138909:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12463:x1875475209224704:12345-192.168.203.47@tcp:58:lfs.0 00010000:00010000:1.0:1788592814.139017:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.139558:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.139575:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592814.139684:0:13208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788592814.139766:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12463:x1875475209224704:12345-192.168.203.47@tcp:58:lfs.0 Request processed in 858us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.139775:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 230 00000100:00100000:2.0:1788592814.143358:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.143394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224832 00000100:00100000:0.0:1788592814.143404:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224832 00000100:00100000:0.0:1788592814.143509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 231 00000100:00100000:0.0:1788592814.143521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+65:12463:x1875475209224832:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592814.143542:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592814.143562:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3102 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.143613:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.143625:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.143643:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.143655:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.143667:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.143670:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592814.143675:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.143690:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1e00, rc 0) 00000100:00100000:0.0:1788592814.143749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12463:x1875475209224832:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 231us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.143757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 231 00000040:00080000:3.0:1788592814.264323:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592814.264333:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592814.264361:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 4 00000040:00080000:3.0:1788592814.264370:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592814.264512:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226042496:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788592814.264610:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592814.267308:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226042496:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592814.267529:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.267815:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209224960 00000100:00100000:1.0:1788592814.267822:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209224960 00000100:00100000:1.0:1788592814.267879:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 232 00000100:00100000:1.0:1788592814.267889:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12464:x1875475209224960:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788592814.267989:0:10029:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788592814.268149:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12464:x1875475209224960:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 261us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.268169:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 232 00000100:00100000:2.0:1788592814.276190:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.276367:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209225088 00000100:00100000:1.0:1788592814.276377:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209225088 00000100:00100000:1.0:1788592814.276444:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 233 00000100:00100000:1.0:1788592814.276460:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12464:x1875475209225088:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788592814.276547:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276564:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276575:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276590:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276597:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276604:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276626:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276635:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276641:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592814.276704:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788592814.276709:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592814.276722:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276733:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276739:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276745:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276750:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592814.276755:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276761:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276772:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:1.0:1788592814.276775:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592814.276779:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276786:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5c9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276800:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276816:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276822:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276827:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592814.276829:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276834:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276842:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9218765dfe00) 00010000:00010000:1.0:1788592814.276844:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592814.276846:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276851:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5ca4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276866:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276871:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276876:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.276880:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592814.276889:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.277481:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.277497:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592814.277540:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592814.277545:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.277552:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.277645:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12464:x1875475209225088:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 Request processed in 1188us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.277655:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 233 00000100:00100000:2.0:1788592814.291666:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.291809:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209225344 00000100:00100000:0.0:1788592814.291819:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209225344 00000100:00100000:0.0:1788592814.292040:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 234 00000100:00100000:0.0:1788592814.292053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+66:12464:x1875475209225344:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592814.292091:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592814.292113:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3109 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292236:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292556:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292572:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592814.292585:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788592814.292668:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292676:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292701:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292707:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.292712:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292720:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292732:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.292735:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592814.292739:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292745:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5cb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292790:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cb2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3109 expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292800:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:0.0:1788592814.292803:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592814.292807:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3109 expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.292817:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1400, rc 0) 00000100:00100000:0.0:1788592814.292885:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12464:x1875475209225344:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 835us (1684us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788592814.293582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 234 00000100:00100000:2.0:1788592814.300042:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.300164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209225472 00000100:00100000:3.0:1788592814.300181:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209225472 00000100:00100000:3.0:1788592814.300261:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 235 00000100:00100000:3.0:1788592814.300274:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12464:x1875475209225472:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592814.300341:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592814.300498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12464:x1875475209225472:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 226us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.300507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 235 00000100:00100000:2.0:1788592814.309845:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.309974:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209225728 00000100:00100000:1.0:1788592814.309988:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209225728 00000100:00100000:1.0:1788592814.310276:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 236 00000100:00100000:1.0:1788592814.310289:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12464:x1875475209225728:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592814.310317:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592814.310321:0:13208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788592814.310355:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5c57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30ed expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.310379:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592814.310385:0:13208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592814.310402:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cc7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3110 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592814.310893:0:13208:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788592814.311141:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5cce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.311158:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.311169:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.311234:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cc7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3110 expref: 69 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.311255:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5cce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3110 expref: 68 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.311264:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765dfe00) 00010000:00010000:1.0:1788592814.311268:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592814.311272:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022be00, rc 0) 00000100:00100000:1.0:1788592814.311359:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12464:x1875475209225728:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 1073us (1529us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788592814.311368:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 236 00000100:00100000:2.0:1788592814.319919:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.320097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209225984 00000100:00100000:0.0:1788592814.320110:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209225984 00000100:00100000:0.0:1788592814.320176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 237 00000100:00100000:0.0:1788592814.320186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12464:x1875475209225984:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592814.320260:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592814.320295:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db5cce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3110 expref: 68 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320319:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765dfe00) 00010000:00010000:0.0:1788592814.320332:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592814.320358:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320375:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320386:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320532:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320556:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320568:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320641:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320649:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320656:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320662:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.320667:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320675:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.320999:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:0.0:1788592814.321002:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.321007:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321014:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1400/0xbd314a3362db5cdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321029:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321035:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321041:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321052:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.321055:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321061:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321111:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc2e8834e (ffff921742463700) 00010000:00010000:0.0:1788592814.321114:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.321117:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.321123:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0000/0xbd314a3362db5ce3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc2e8834e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.321239:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12464:x1875475209225984:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 1050us (1331us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592814.321249:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 237 00000100:00100000:3.0:1788592814.323427:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.325829:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209226112 00000100:00100000:0.0:1788592814.325849:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209226112 00000100:00100000:1.0:1788592814.333817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 238 00000100:00100000:1.0:1788592814.333836:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+67:12464:x1875475209226112:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592814.333865:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592814.333897:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3117 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.333969:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.333987:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.334001:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.334147:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5cea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.334166:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.334175:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:1.0:1788592814.334178:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592814.334183:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a800, rc 0) 00000100:00100000:1.0:1788592814.334274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12464:x1875475209226112:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 443us (10859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.334281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 238 00000100:00100000:2.0:1788592814.336886:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.337022:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209226368 00000100:00100000:1.0:1788592814.337034:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209226368 00000100:00100000:1.0:1788592814.337135:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 239 00000100:00100000:1.0:1788592814.337145:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+68:12464:x1875475209226368:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592814.337240:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.337281:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.337293:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592814.337498:0:13208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1788592814.337559:0:13208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001daf2015 reply state 000000006014b1aa transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.337574:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.337582:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:1.0:1788592814.337586:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788592814.337590:0:13208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592814.337692:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+70:12464:x1875475209226368:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 547us (816us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788592814.337699:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 239 00000100:00100000:3.0:1788592814.339394:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.339505:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209226496 00000100:00100000:1.0:1788592814.339516:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209226496 00000100:00100000:1.0:1788592814.339575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 240 00000100:00100000:1.0:1788592814.339584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+70:12464:x1875475209226496:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592814.339609:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592814.339628:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c311e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.339714:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.339736:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.339757:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:1.0:1788592814.339760:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592814.339764:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b600, rc 0) 00000100:00100000:1.0:1788592814.339807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+71:12464:x1875475209226496:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 224us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.339814:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 240 00000100:00100000:2.0:1788592814.342279:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.342376:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209226624 00000100:00100000:0.0:1788592814.342387:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209226624 00000100:00100000:0.0:1788592814.342458:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:0.0:1788592814.342479:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2395:x1875475209226624:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788592814.342764:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2395:x1875475209226624:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 295us (496us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788592814.342773:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 71 00000100:00100000:2.0:1788592814.345024:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.345198:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209226880 00000100:00100000:1.0:1788592814.345209:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209226880 00000100:00100000:1.0:1788592814.345256:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1788592814.345265:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+71:12464:x1875475209226880:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592814.345523:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+72:12464:x1875475209226880:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 258us (509us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788592814.345531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:3.0:1788592814.347368:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.347453:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209227136 00000100:00100000:2.0:1788592814.347462:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209227136 00000100:00100000:2.0:1788592814.347533:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 241 00000100:00100000:2.0:1788592814.347544:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+72:12464:x1875475209227136:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788592814.347658:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+72:12464:x1875475209227136:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592814.347666:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 241 00000100:00100000:2.0:1788592814.349755:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.349837:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209227264 00000100:00100000:3.0:1788592814.349847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209227264 00000100:00100000:3.0:1788592814.349908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 242 00000100:00100000:3.0:1788592814.349924:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+72:12464:x1875475209227264:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592814.349945:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592814.349971:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3125 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.350063:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5d0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.350126:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.350140:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592814.350195:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592814.350217:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.350245:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3125 expref: 74 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.350286:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5d0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3125 expref: 73 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.350296:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:3.0:1788592814.350299:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788592814.350302:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205e600, rc 0) 00000100:00100000:3.0:1788592814.350362:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+73:12464:x1875475209227264:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 439us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.350370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 242 00000100:00100000:3.0:1788592814.352981:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.353113:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209227392 00000100:00100000:0.0:1788592814.353141:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209227392 00000100:00100000:0.0:1788592814.353202:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:0.0:1788592814.353213:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+10:2396:x1875475209227392:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592814.353233:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592814.353258:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c312c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592814.353287:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc2ae, blocks: 0x0 00010000:00010000:0.0:1788592814.353310:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1788592814.353315:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592814.353327:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.353347:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.353362:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0000, rc 0) 00000100:00100000:0.0:1788592814.353428:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2396:x1875475209227392:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 217us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.353435:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 72 00000100:00100000:2.0:1788592814.355924:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.356002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209227648 00000100:00100000:3.0:1788592814.356013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209227648 00000100:00100000:3.0:1788592814.356121:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 243 00000100:00100000:3.0:1788592814.356131:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+73:12464:x1875475209227648:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788592814.356254:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+73:12464:x1875475209227648:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 124us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.356263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 243 00000100:00100000:2.0:1788592814.359434:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.359579:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209227776 00000100:00100000:0.0:1788592814.359593:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209227776 00000100:00100000:0.0:1788592814.359670:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:0.0:1788592814.359682:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:12464:x1875475209227776:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592814.359705:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592814.359729:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3133 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.359776:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.359787:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592814.359791:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592814.359797:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.359841:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.359857:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 12 pid: 8428 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.359874:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875475226042624:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592814.360320:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592814.362829:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.362871:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875475226042624:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592814.362919:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.362946:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1c00, rc 0) 00000100:00100000:2.0:1788592814.363099:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209227904 00000100:00100000:2.0:1788592814.363108:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209227904 00000100:00100000:3.0:1788592814.363143:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:12464:x1875475209227776:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 3463us (3722us total) trans 0 rc 0/0 00010000:00010000:2.0:1788592814.363145:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 13 pid: 8428 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.363170:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 73 00000100:00100000:2.0:1788592814.363324:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:2.0:1788592814.363332:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+12:2396:x1875475209227904:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592814.363345:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592814.363366:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 12 pid: 8428 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.363377:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 12 pid: 8428 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.363399:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000864cc892/0xbd314a3362db5d14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c312c expref: 12 pid: 8428 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.363412:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592814.363415:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592814.363425:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.363436:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.363489:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.363519:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10331:1875475226042752:192.168.203.47@tcp:105: 00000100:00100000:2.0:1788592814.363595:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592814.369953:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10331:1875475226042752:192.168.203.47@tcp:105: 00010000:00010000:2.0:1788592814.370155:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592814.370282:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2396:x1875475209227904:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 6948us (7464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592814.370296:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 103 00000100:00100000:0.0:1788592814.373544:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.373691:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209228032 00000100:00100000:2.0:1788592814.373704:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209228032 00002000:00100000:2.0:1788592814.373771:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff921744557800 x1875475209228032/t0(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:90/0 lens 504/0 e 0 to 0 dl 1788592825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592814.373783:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744557800 with x1875475209228032 ext(0->12) 00002000:00010000:2.0:1788592814.373792:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744557800 00000100:00100000:2.0:1788592814.373862:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:2.0:1788592814.373874:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+11:2396:x1875475209228032:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788592814.379058:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:2396:x1875475209228032:12345-192.168.203.47@tcp:4:lhsmtool_posix.0 Request processed in 5168us (5509us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788592814.379090:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00002000:00100000:2.0:1788592814.379111:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff921744557800 x1875475209228032/t4294967321(0) o4->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:90/0 lens 504/448 e 0 to 0 dl 1788592825 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592814.379123:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744557800 with x1875475209228032 ext(0->12) 00002000:00010000:2.0:1788592814.379132:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744557800 00000100:00100000:3.0:1788592814.385042:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.385196:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209228160 00000100:00100000:1.0:1788592814.385208:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209228160 00000100:00100000:1.0:1788592814.385278:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 244 00000100:00100000:1.0:1788592814.385288:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+73:12464:x1875475209228160:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788592814.387880:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788592814.387927:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788592814.387958:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92184546a840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788592814.387964:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921849764b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92184546a6c0 00000020:00080000:3.0:1788592814.387967:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921849764200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9217424a5400 00000004:00080000:3.0:1788592814.388003:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788592814.388031:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788592814.388051:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92185b207480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788592814.388058:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921743b96000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92185b2070c0 00000020:00080000:3.0:1788592814.388061:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921743b96a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff921743a48000 00000020:00080000:2.0:1788592814.388097:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000020:00080000:3.0:1788592814.388109:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788592814.388181:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788592814.388244:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592814.388259:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592814.388270:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226042880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788592814.388273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226043008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788592814.389607:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592814.389682:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226042880 00000100:00100000:3.0:1788592814.389692:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226042880 00000100:00100000:3.0:1788592814.389757:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788592814.389774:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226042880:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788592814.389775:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12464:x1875475209228160:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 Request processed in 4473us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592814.389794:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 244 00002000:00080000:3.0:1788592814.389846:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788592814.389879:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.389907:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.389929:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788592814.389934:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592814.389940:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.389978:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.389995:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 12 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.390008:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875475226043136:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592814.390095:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185b55de40 going to sleep for 11 seconds 00010000:00010000:0.0:1788592814.390351:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390362:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390370:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390388:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.390393:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390402:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390421:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff92174372d900) 00010000:00010000:0.0:1788592814.390425:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.390430:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390437:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0200/0xbd314a3362db5a20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390464:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390481:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390488:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390493:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.390496:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390503:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390523:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff921882176900) 00010000:00010000:0.0:1788592814.390526:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.390530:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390536:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839400/0xbd314a3362db5ac8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.390544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592814.390561:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390570:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390577:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390583:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.390587:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390594:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.390598:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226043008 00010000:00010000:0.0:1788592814.390603:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:0.0:1788592814.390606:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.390611:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.390613:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226043008 00010000:00010000:0.0:1788592814.390622:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205ee00/0xbd314a3362db5b46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390647:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390654:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390660:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390665:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.390668:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390674:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390683:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921882176100) 00010000:00010000:0.0:1788592814.390686:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.390689:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390695:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e800/0xbd314a3362db5b69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390718:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.390724:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788592814.390727:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390734:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.390746:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1875475226043008:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788592814.390746:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.390752:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390760:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788592814.390769:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788592814.390769:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.390775:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592814.390779:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390786:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5c3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390799:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592814.390806:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bc2ad, atime: 0x6a9bc2ad, ctime: 0x6a9bc2ad, blocks: 0x8 00010000:00010000:0.0:1788592814.390806:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.390822:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390822:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390836:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592814.390842:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.390844:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1788592814.390853:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592814.390856:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.390862:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390891:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:1.0:1788592814.390893:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390895:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592814.390901:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.390908:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390912:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5cf8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.390922:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.390944:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592814.390953:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592814.390960:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390969:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592814.390973:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390981:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.390994:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.391002:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d148ca/0xbd314a3362db5d29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.391017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592814.391019:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592814.391027:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592814.391168:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3640:x1875475226043008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 435us (627us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788592814.391175:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1788592814.391502:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92174477dc00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788592814.391518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226043008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788592814.392829:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226043264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592814.392893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592814.392982:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226043264 00000100:00100000:0.0:1788592814.392990:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226043264 00000100:00100000:0.0:1788592814.393045:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788592814.393055:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226043264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788592814.393098:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788592814.393481:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.393505:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209228288 00000100:00100000:1.0:1788592814.393510:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209228288 00000100:00100000:1.0:1788592814.393543:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:1.0:1788592814.393551:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+13:2395:x1875475209228288:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788592814.395203:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788592814.395235:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:1.0:1788592814.395589:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209228288:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 Request processed in 2030us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.395601:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 76 00000100:00100000:3.0:1788592814.398362:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875475226043136:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592814.398403:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.398509:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.398561:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209228416 00000100:00100000:3.0:1788592814.398569:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209228416 00010000:00010000:3.0:1788592814.398612:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 8 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.398650:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 104 00000100:00100000:3.0:1788592814.398677:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2395:x1875475209228416:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592814.398696:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592814.398703:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 8 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398717:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 8 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398744:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a92340b3/0xbd314a3362db5ad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c308b expref: 8 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398763:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592814.398768:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592814.398774:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398786:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398812:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592814.398858:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209228416:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 183us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.398866:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 104 00010000:00010000:3.0:1788592814.398891:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398912:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398923:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398931:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.398951:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788592814.399194:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226042880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9426us (9592us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788592814.399203:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788592814.399222:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592814.399229:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.399238:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205fa00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592814.399243:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.399253:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.399265:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.399280:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003031ef2e/0xbd314a3362db5d22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.399301:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592814.399303:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592814.399305:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592814.399335:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1788592814.399342:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1788592814.399364:0:3641:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff92174477aa00 x1875475226042880/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788592830 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788592814.399378:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92174477aa00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788592814.399389:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226042880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788592814.399623:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226043264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6567us (6726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592814.399631:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226043264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592814.399634:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000001:00080000:0.0:1788592814.400707:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788592814.400721:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788592814.404438:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.404553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209228672 00000100:00100000:0.0:1788592814.404567:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209228672 00000100:00100000:0.0:1788592814.404641:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 245 00000100:00100000:0.0:1788592814.404653:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12464:x1875475209228672:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592814.404727:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592814.404766:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205e600/0xbd314a3362db5d0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3125 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.404790:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:0.0:1788592814.404796:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592814.404834:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.404853:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.404865:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592814.405533:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000435dc154 reply state 00000000117e6f4f transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.405550:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.405558:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:0.0:1788592814.405560:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592814.405564:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592814.405690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:12464:x1875475209228672:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 1038us (1265us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788592814.405699:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 245 00000100:00100000:1.0:1788592814.408019:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.408176:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209228800 00000100:00100000:0.0:1788592814.408189:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209228800 00000100:00100000:0.0:1788592814.408254:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:0.0:1788592814.408271:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2394:x1875475209228800:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788592814.408450:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788592814.408455:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788592813 00002000:00010000:0.0:1788592814.408457:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788592813 00002000:00010000:0.0:1788592814.408459:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788592814 -> 1788592813 00002000:00010000:0.0:1788592814.408461:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788592814.408530:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2394:x1875475209228800:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 261us (524us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788592814.408537:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 77 00000100:00100000:1.0:1788592814.411203:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.411318:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229056 00000100:00100000:2.0:1788592814.411331:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229056 00000100:00100000:2.0:1788592814.411401:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 246 00000100:00100000:2.0:1788592814.411413:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:12464:x1875475209229056:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788592814.411515:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.411536:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.411546:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.411590:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.411605:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 22 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.411647:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226043392:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592814.411778:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.414845:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.415567:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229184 00000100:00100000:0.0:1788592814.415582:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229184 00010000:00010000:0.0:1788592814.415640:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 23 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.415721:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 105 00000100:00100000:0.0:1788592814.415733:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:2396:x1875475209229184:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592814.415753:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592814.415761:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 23 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.415778:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 23 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.415807:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:0.0:1788592814.415814:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.415826:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.415835:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.415858:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592814.415983:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+23:2396:x1875475209229184:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 252us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.415990:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 105 00010000:00010000:2.0:1788592814.416580:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a800/0xbd314a3362db5cf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3117 expref: 22 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.416605:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226043392:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592814.416632:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416643:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416649:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416699:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416706:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416714:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416720:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592814.416725:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416749:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416762:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:2.0:1788592814.416765:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788592814.416769:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.416776:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.416830:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12464:x1875475209229056:12345-192.168.203.47@tcp:55:lhsmtool_posix.0 Request processed in 5420us (5641us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788592814.416840:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 246 00000100:00100000:3.0:1788592814.418984:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.419124:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229312 00000100:00100000:2.0:1788592814.419135:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229312 00000100:00100000:2.0:1788592814.419199:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 78 00000100:00100000:2.0:1788592814.419209:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2396:x1875475209229312:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788592814.419263:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.419289:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.419298:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592814.419303:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592814.419309:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.419365:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.419383:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 8 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.419402:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10091:1875475226043520:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592814.419937:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22180 going to sleep for 11 seconds 00000100:00100000:3.0:1788592814.423547:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.423646:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229440 00000100:00100000:1.0:1788592814.423660:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229440 00010000:00010000:1.0:1788592814.423712:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 9 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.423762:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 106 00000100:00100000:1.0:1788592814.423772:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209229440:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592814.423791:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592814.423821:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 9 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.423864:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 9 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.423898:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592814.423904:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592814.423922:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.423940:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.423966:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592814.424025:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+9:2396:x1875475209229440:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 254us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.424033:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 106 00010000:00010000:2.0:1788592814.425598:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004012a48b/0xbd314a3362db5d1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3133 expref: 8 pid: 8427 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.425624:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10091:1875475226043520:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592814.425652:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425665:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425673:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425704:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425736:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425745:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425753:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592814.425759:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425769:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425789:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.425797:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000084d9d5/0xbd314a3362db5d3e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.426148:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2396:x1875475209229312:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 Request processed in 6937us (7174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592814.426159:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 78 00000100:00100000:3.0:1788592814.428298:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.428403:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229696 00000100:00100000:2.0:1788592814.428416:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229696 00000100:00100000:2.0:1788592814.428526:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 247 00000100:00100000:2.0:1788592814.428558:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:12464:x1875475209229696:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788592814.428668:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.428688:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.428700:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.428742:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.428757:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 21 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.428773:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226043648:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592814.428876:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592814.432303:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226043648:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592814.432319:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00010000:00010000:2.0:1788592814.432347:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.432423:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229824 00000100:00100000:0.0:1788592814.432432:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229824 00010000:00010000:0.0:1788592814.432491:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 22 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.432564:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 107 00000100:00100000:0.0:1788592814.432576:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:2395:x1875475209229824:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592814.432596:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592814.432605:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 22 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432619:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 22 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432647:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839a00/0xbd314a3362db5c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30df expref: 22 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432666:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:0.0:1788592814.432672:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432683:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432690:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432699:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592814.432724:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592814.432787:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:2395:x1875475209229824:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 213us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.432803:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 107 00010000:00010000:2.0:1788592814.434440:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.434457:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.434711:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.434746:0:13208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.434756:0:13208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.434805:0:13208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.434824:0:13208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 21 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.434843:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226043776:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592814.434966:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.438326:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.438663:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226043776:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592814.438700:0:13208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.438896:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209229952 00000100:00100000:3.0:1788592814.438906:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209229952 00010000:00010000:3.0:1788592814.439007:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 22 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592814.439195:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 108 00000100:00100000:3.0:1788592814.439207:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:2396:x1875475209229952:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592814.439226:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592814.439234:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 22 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.439269:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 22 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.439297:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b600/0xbd314a3362db5cff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c311e expref: 22 pid: 6514 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.439315:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:3.0:1788592814.439320:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.439330:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.439340:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.439407:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592814.439483:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:2396:x1875475209229952:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 278us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.439490:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 108 00010000:00010000:2.0:1788592814.440490:0:13208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.440503:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592814.440650:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788592814.440800:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788592814.440841:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788592814.440956:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226043904:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788592814.441297:0:13208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592814.441370:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592814.441630:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226043904 00000100:00100000:3.0:1788592814.441639:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226043904 00000100:00100000:3.0:1788592814.441729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788592814.441740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13208:x1875475226043904:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788592814.441851:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13208:x1875475226043904:12345-0@lo:1000:mdt00_004.0 Request processed in 111us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.441859:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788592814.441963:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226043904:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788592814.442149:0:13208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788592814.442214:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226044032:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788592814.442250:0:13208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592814.442601:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592814.442670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226044032 00000100:00100000:2.0:1788592814.442677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226044032 00000100:00100000:2.0:1788592814.442710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788592814.442717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13208:x1875475226044032:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788592814.442840:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13208:x1875475226044032:12345-0@lo:1000:mdt00_004.0 Request processed in 122us (588us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788592814.442847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788592814.442937:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13208:1875475226044032:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788592814.442981:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443003:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443012:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443019:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e000 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592814.443024:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443043:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443063:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:1.0:1788592814.443091:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592814.443098:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443105:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e000/0xbd314a3362db5d4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443133:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443139:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443144:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443148:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022bc00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592814.443158:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443165:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443173:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592814.443176:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592814.443183:0:13208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443196:0:13208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443206:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.443237:0:13208:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.443251:0:13208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226044160:192.168.203.47@tcp:105: 00000100:00100000:1.0:1788592814.443326:0:13208:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.446954:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.447228:0:13208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13208:1875475226044160:192.168.203.47@tcp:105: 00010000:00010000:2.0:1788592814.447264:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447276:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022bc00/0xbd314a3362db5c8f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447318:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447335:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447349:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447360:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447366:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447397:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447403:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592814.447408:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447416:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447430:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:2.0:1788592814.447434:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592814.447439:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447445:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447457:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447474:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447480:0:13208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447486:0:13208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592814.447489:0:13208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447505:0:13208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447515:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:2.0:1788592814.447517:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592814.447521:0:13208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.447527:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d45 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.447732:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:12464:x1875475209229696:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 19175us (19444us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788592814.447745:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 247 00000020:00080000:2.0:1788592814.447751:0:13208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788592814.447912:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592814.447919:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592814.448421:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788592814.448432:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592814.450560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209230080 00000100:00100000:3.0:1788592814.450579:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209230080 00000100:00100000:2.0:1788592814.450733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:2.0:1788592814.450745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:12463:x1875475209230080:12345-192.168.203.47@tcp:49:lfs.0 00000100:00100000:2.0:1788592814.450909:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:12463:x1875475209230080:12345-192.168.203.47@tcp:49:lfs.0 Request processed in 165us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592814.450934:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:1.0:1788592814.453863:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.453946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209230336 00000100:00100000:2.0:1788592814.453960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209230336 00000100:00100000:2.0:1788592814.454029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:2.0:1788592814.454040:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921869699850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+24:12464:x1875475209230336:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788592814.454415:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788592814.454454:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788592814.454530:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.454551:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.454566:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.454576:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.454583:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.454590:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.454610:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788592814.454715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921869699850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+26:12464:x1875475209230336:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 676us (866us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788592814.454725:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000020:00080000:2.0:1788592814.454730:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788592814.455022:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592814.455038:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.455046:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592814.455052:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.455061:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.455104:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:1.0:1788592814.455107:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788592814.455113:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.455119:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e600/0xbd314a3362db5d5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.455135:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592814.455137:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592814.455138:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592814.456606:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592814.456704:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209230592 00000100:00100000:0.0:1788592814.456717:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209230592 00000100:00100000:0.0:1788592814.456786:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 248 00000100:00100000:0.0:1788592814.456797:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+26:12463:x1875475209230592:12345-192.168.203.47@tcp:58:lfs.0 00000040:00080000:0.0:1788592814.457016:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788592814.457129:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+26:12463:x1875475209230592:12345-192.168.203.47@tcp:58:lfs.0 Request processed in 332us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592814.457137:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 248 00000100:00100000:3.0:1788592814.482053:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592814.482241:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209230720 00000100:00100000:2.0:1788592814.482255:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209230720 00000100:00100000:2.0:1788592814.482329:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 249 00000100:00100000:2.0:1788592814.482342:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+26:12466:x1875475209230720:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:2.0:1788592814.482374:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592814.482402:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c313a expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482518:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482536:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482550:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482564:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482572:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482578:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482664:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482675:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 27 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482684:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482726:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 27 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592814.482753:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 27 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592814.482769:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226044288:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592814.482870:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186b9b9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592814.485437:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592814.485536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209230976 00000100:00100000:3.0:1788592814.485547:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209230976 00000100:00100000:3.0:1788592814.485612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:3.0:1788592814.485624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+28:6160:x1875475209230976:12345-192.168.203.47@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788592814.485902:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921842c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:6160:x1875475209230976:12345-192.168.203.47@tcp:35:ldlm_bl.0 Request processed in 280us (477us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788592814.485912:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:2.0:1788592814.486410:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10029:1875475226044288:192.168.203.47@tcp:104: 00010000:00010000:2.0:1788592814.486442:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592814.489276:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592814.489391:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209231104 00000100:00100000:1.0:1788592814.489403:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209231104 00010000:00010000:1.0:1788592814.489454:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 29 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592814.489518:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 109 00000100:00100000:1.0:1788592814.489529:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:2393:x1875475209231104:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592814.489551:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592814.489559:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 29 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.489594:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 29 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.489624:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db5c81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c30fb expref: 29 pid: 10029 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.489644:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592814.489650:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.489661:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.489670:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592814.489712:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592814.489778:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+28:2393:x1875475209231104:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 250us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592814.489786:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 109 00010000:00010000:3.0:1788592814.490370:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490382:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592814.490444:0:10029:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788592814.490450:0:10029:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592814.490486:0:10029:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490503:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490514:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490522:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490545:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490551:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592814.490556:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490565:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490578:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:3.0:1788592814.490581:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592814.490586:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490592:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820f400/0xbd314a3362db5d68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490605:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490611:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490617:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490621:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ea00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592814.490624:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490639:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490646:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff921743724c00) 00010000:00010000:3.0:1788592814.490649:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592814.490652:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490658:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ea00/0xbd314a3362db5d6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490699:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e200/0xbd314a3362db5d61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c313a expref: 28 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490714:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c313a expref: 27 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592814.490723:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592814.490725:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592814.490728:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820ee00, rc 0) 00000100:00100000:3.0:1788592814.490778:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12466:x1875475209230720:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 8439us (8749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.490787:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 249 00000100:00100000:0.0:1788592814.904344:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592814.904374:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592814.904471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592814.904605:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226044416 00000100:00100000:3.0:1788592814.904614:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226044416 00000100:00100000:3.0:1788592814.904671:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788592814.904681:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226044416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788592814.904717:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788592814.904776:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226044416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.904784:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788592814.904858:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226044544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592814.904884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592814.904934:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592814.904992:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226044544 00000100:00100000:3.0:1788592814.904996:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226044544 00000100:00100000:3.0:1788592814.905026:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788592814.905032:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226044544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592814.905043:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788592814.905100:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226044544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592814.905107:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788592814.905129:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788592814.905136:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788592814.905157:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9217445afb80, transno 4294967308 00000004:00080000:3.0:1788592814.905168:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788592814.905183:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92174477dc00, transno 4294967311 00000100:00100000:3.0:1788592814.905191:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226044544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788592815.032220:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592815.131242:0:14745:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592815.131252:0:14745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592815.131290:0:14745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:0.0:1788592815.131298:0:14745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788592815.482324:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592815.482333:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592815.482361:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:1.0:1788592815.482371:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592815.482514:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226044672:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592815.482608:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff921847dcf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592815.486374:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875475226044672:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592815.488807:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592815.489206:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209231232 00000100:00100000:2.0:1788592815.489216:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209231232 00000100:00100000:2.0:1788592815.489302:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 250 00000100:00100000:2.0:1788592815.489313:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12478:x1875475209231232:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1788592815.489335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1788592815.489348:0:13208:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592815.489474:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12478:x1875475209231232:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 162us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592815.489483:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 250 00000100:00100000:0.0:1788592815.493904:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592815.494044:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209231488 00000100:00100000:3.0:1788592815.494055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209231488 00000100:00100000:3.0:1788592815.494169:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 251 00000100:00100000:3.0:1788592815.494180:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184fe12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+27:12478:x1875475209231488:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592815.494211:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592815.494231:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3141 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.494342:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.494373:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.494385:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592815.494398:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788592815.494528:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3141 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.494548:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3141 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.494556:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592815.494559:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592815.494563:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205fa00, rc 0) 00000100:00100000:3.0:1788592815.494621:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184fe12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:12478:x1875475209231488:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 442us (726us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788592815.494628:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 251 00000100:00100000:0.0:1788592815.500311:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592815.500385:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209231744 00000100:00100000:3.0:1788592815.500394:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209231744 00000100:00100000:3.0:1788592815.500467:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 252 00000100:00100000:3.0:1788592815.500476:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:12478:x1875475209231744:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788592815.500551:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500568:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500592:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500760:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500768:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500774:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500779:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592815.500784:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500791:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500803:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592815.500806:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788592815.500812:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.500817:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5d92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592815.500949:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:12478:x1875475209231744:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 472us (647us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788592815.500956:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 252 00000040:00080000:2.0:1788592815.500997:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592815.501002:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592815.501535:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1788592815.501544:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592815.502416:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592815.502492:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209231872 00000100:00100000:3.0:1788592815.502499:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209231872 00000100:00100000:3.0:1788592815.502554:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:3.0:1788592815.502563:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:2395:x1875475209231872:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592815.502576:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592815.502596:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205fa00/0xbd314a3362db5d84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3141 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592815.502612:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592815.502617:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592815.502665:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:2395:x1875475209231872:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592815.502673:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:0.0:1788592815.505966:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592815.506387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232128 00000100:00100000:3.0:1788592815.506396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232128 00000100:00100000:2.0:1788592815.506612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:2.0:1788592815.506623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+29:12478:x1875475209232128:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788592815.506861:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:12478:x1875475209232128:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 239us (902us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788592815.506879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00010000:00010000:3.0:1788592816.056892:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592816.057131:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.057170:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.057201:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.057232:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.057250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.057273:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.057298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232768 00000100:00100000:1.0:1788592816.057307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232768 00000100:00100000:1.0:1788592816.057356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232384 00000100:00100000:1.0:1788592816.057359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232384 00000100:00100000:1.0:1788592816.057374:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232896 00000100:00100000:1.0:1788592816.057448:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232896 00000100:00100000:1.0:1788592816.057480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 279 00000100:00100000:1.0:1788592816.057490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209232768:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592816.057578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209232768:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592816.057585:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 279 00000100:00100000:1.0:1788592816.057602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 280 00000100:00100000:1.0:1788592816.057608:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209232384:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592816.057632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209232384:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592816.057637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 280 00000100:00100000:1.0:1788592816.057648:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 281 00000100:00100000:1.0:1788592816.057654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209232896:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592816.057677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2394:x1875475209232896:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592816.057698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 281 00000100:00100000:3.0:1788592816.057860:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232512 00000100:00100000:3.0:1788592816.057865:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232512 00000100:00100000:3.0:1788592816.057899:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232640 00000100:00100000:3.0:1788592816.057902:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232640 00000100:00100000:3.0:1788592816.057920:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:3.0:1788592816.057926:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209232512:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592816.057954:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2394:x1875475209232512:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592816.057959:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:3.0:1788592816.057970:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:3.0:1788592816.057976:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2394:x1875475209232640:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592816.058008:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2394:x1875475209232640:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592816.058015:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:0.0:1788592816.058754:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209232256 00000100:00100000:0.0:1788592816.058760:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209232256 00000100:00100000:0.0:1788592816.058808:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 379 00000100:00100000:0.0:1788592816.058816:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209232256:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592816.058846:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fde4749-eba3-4045-af7c-c124eb85a251+13:2394:x1875475209232256:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 32us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592816.058852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 379 00000100:00080000:0.0:1788592816.058883:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592816.058887:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592816.058890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592816.058892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788592816.785812:0:14797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592816.785822:0:14797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592816.785855:0:14797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:1.0:1788592816.785861:0:14797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592816.956312:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592816.956333:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226044800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592816.956398:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592816.956446:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226044800 00000100:00100000:0.0:1788592816.956463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226044800 00000100:00100000:0.0:1788592816.956508:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788592816.956516:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226044800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592816.956549:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788592816.956651:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226044800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592816.956659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788592816.956993:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226044800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592816.957184:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592816.957315:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226044928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592816.957350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592816.957431:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226044928 00000100:00100000:0.0:1788592816.957436:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226044928 00000100:00100000:0.0:1788592816.957510:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788592816.957518:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226044928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788592816.957538:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788592816.957592:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226044928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592816.957599:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788592816.957651:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226044928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592816.963411:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592816.963658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209233152 00000100:00100000:1.0:1788592816.963668:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209233152 00000100:00100000:1.0:1788592816.963771:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 253 00000100:00100000:1.0:1788592816.963783:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+30:12498:x1875475209233152:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:1.0:1788592816.963807:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592816.963829:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5d99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3148 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592816.963936:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5da0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592816.963952:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5da0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592816.963966:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5da0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592816.963976:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788592816.964251:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a600/0xbd314a3362db5d99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3148 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592816.964287:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5da0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3148 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592816.964296:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592816.964299:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788592816.964302:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b000, rc 0) 00000100:00100000:1.0:1788592816.964397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:12498:x1875475209233152:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 616us (995us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788592816.964402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 253 00000100:00100000:0.0:1788592816.968277:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592816.968466:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209233280 00000100:00100000:3.0:1788592816.968477:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209233280 00000100:00100000:3.0:1788592816.968537:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 254 00000100:00100000:3.0:1788592816.968549:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:12498:x1875475209233280:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:3.0:1788592816.968615:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968646:0:10029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968659:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968697:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968705:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968711:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968717:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592816.968721:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968746:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968759:0:10029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:3.0:1788592816.968762:0:10029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592816.968767:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592816.968774:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f400/0xbd314a3362db5dae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10029 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592816.968846:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+32:12498:x1875475209233280:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 300us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592816.968854:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 254 00000100:00100000:0.0:1788592817.073203:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592817.074560:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209233408 00000100:00100000:2.0:1788592817.074583:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209233408 00000100:00100000:2.0:1788592817.074649:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 79 00000100:00100000:2.0:1788592817.074660:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2394:x1875475209233408:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:2.0:1788592817.074676:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592817.074696:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb4eab4/0xbd314a3362db5db5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c314f expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592817.074735:0:10091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9bc2ad, atime: 0x6a9bc2ad, ctime: 0x6a9bc2ad, blocks: 0x8 00010000:00010000:2.0:1788592817.074756:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788592817.074760:0:10091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592817.074770:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb4eab4/0xbd314a3362db5db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c314f expref: 8 pid: 10091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592817.074788:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddb4eab4/0xbd314a3362db5db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c314f expref: 8 pid: 10091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592817.074801:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e600, rc 0) 00000100:00100000:2.0:1788592817.074864:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2394:x1875475209233408:12345-192.168.203.47@tcp:101:cat.0 Request processed in 206us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592817.074871:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 79 00010000:00010000:1.0:1788592817.080364:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592817.087897:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592817.087990:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209233536 00000100:00100000:1.0:1788592817.088000:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209233536 00002000:00100000:1.0:1788592817.088060:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff921744774000 x1875475209233536/t0(0) o3->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:93/0 lens 488/0 e 0 to 0 dl 1788592828 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592817.088104:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744774000 with x1875475209233536 ext(0->4095) 00002000:00010000:1.0:1788592817.088110:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744774000 00000100:00100000:1.0:1788592817.088135:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:1.0:1788592817.088144:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2394:x1875475209233536:12345-192.168.203.47@tcp:3:cat.0 00000100:00100000:1.0:1788592817.088293:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+8:2394:x1875475209233536:12345-192.168.203.47@tcp:3:cat.0 Request processed in 149us (404us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788592817.088301:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00002000:00100000:1.0:1788592817.088308:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff921744774000 x1875475209233536/t0(0) o3->7fa053f8-dea8-45a9-81cb-9946b4fa9e00@192.168.203.47@tcp:93/0 lens 488/4536 e 0 to 0 dl 1788592828 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592817.088316:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff921744774000 with x1875475209233536 ext(0->4095) 00002000:00010000:1.0:1788592817.088334:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff921744774000 00010000:00010000:3.0:1788592818.105155:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592818.554736:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592818.554747:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592818.554841:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788592818.554849:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788592818.680733:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788592819.000563:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226045184:0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.000624:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226045312:0@lo:400:kworker.0 00000100:00100000:1.0:1788592819.000636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788592819.000742:0:10033:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353247673730ns, next at 354247671161ns, rc = 0 00000100:00100000:3.0:1788592819.000758:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226045056:0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.000806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592819.000837:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226045696:0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.000840:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226045824:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.000853:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045312 00000100:00100000:0.0:1788592819.000862:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045312 00000100:00100000:2.0:1788592819.000873:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592819.000896:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226046336:0@lo:400:kworker.0 00000100:00100000:1.0:1788592819.000902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592819.000917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788592819.000923:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592819.000923:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226046208:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.000932:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226045312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.000943:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788592819.000946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592819.000950:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226045440:0@lo:400:kworker.0 00000100:00100000:1.0:1788592819.000962:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226046720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592819.000977:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592819.000991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592819.001004:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226045312:12345-0@lo:400:kworker.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592819.001007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226045952:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001018:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788592819.001022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045184 00000100:00100000:1.0:1788592819.001028:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045184 00000100:00100000:2.0:1788592819.001037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592819.001039:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045440 00000100:00100000:0.0:1788592819.001044:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045440 00000100:00100000:1.0:1788592819.001055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045824 00000100:00100000:2.0:1788592819.001056:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226046464:0@lo:400:kworker.0 00000100:00100000:1.0:1788592819.001059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045824 00000100:00100000:0.0:1788592819.001098:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788592819.001107:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226045440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.001115:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592819.001154:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226045312:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001155:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226045440:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788592819.001189:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045696 00000100:00100000:2.0:1788592819.001191:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226045440:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001195:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045696 00000100:00100000:2.0:1788592819.001220:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046336 00000100:00100000:2.0:1788592819.001225:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046336 00000100:00100000:0.0:1788592819.001228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046208 00000100:00100000:0.0:1788592819.001234:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046208 00000100:00100000:0.0:1788592819.001248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788592819.001254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001288:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226045184:12345-0@lo:400:kworker.0 Request processed in 34us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001306:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788592819.001317:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788592819.001322:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226045696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001346:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226045696:12345-0@lo:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788592819.001359:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788592819.001364:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226046208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001382:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226046208:12345-0@lo:400:kworker.0 Request processed in 19us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788592819.001405:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045952 00000100:00100000:0.0:1788592819.001408:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045952 00000100:00100000:0.0:1788592819.001427:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046464 00000100:00100000:0.0:1788592819.001429:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046464 00000100:00100000:0.0:1788592819.001458:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788592819.001464:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226045952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001492:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226045952:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001497:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788592819.001507:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788592819.001511:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226046464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001531:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226046464:12345-0@lo:400:kworker.0 Request processed in 20us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001536:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788592819.001616:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592819.001620:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592819.001623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592819.001649:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226045696:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001658:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226046208:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001666:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226045184:0@lo:400:kworker.0 00000100:00100000:0.0:1788592819.001708:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046720 00000100:00100000:0.0:1788592819.001711:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046720 00000100:00100000:0.0:1788592819.001741:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788592819.001746:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875475226046720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592819.001778:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788592819.001815:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875475226046720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592819.001821:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788592819.001839:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592819.001860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226046720:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788592819.001880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592819.001897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788592819.003910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592819.003968:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226045568:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592819.004025:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226046080:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592819.004063:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226046592:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592819.004150:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045056 00000100:00100000:3.0:1788592819.004156:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045056 00000100:00100000:3.0:1788592819.004492:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788592819.004517:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226045056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004570:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3641:x1875475226045056:12345-0@lo:400:kworker.0 Request processed in 55us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592819.004578:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788592819.004626:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226045056:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004680:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226045952:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004692:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226046464:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004718:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046080 00000100:00100000:3.0:1788592819.004722:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046080 00000100:00100000:3.0:1788592819.004755:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046592 00000100:00100000:3.0:1788592819.004758:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046592 00000100:00100000:3.0:1788592819.004780:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788592819.004786:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226046080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004823:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226046080:12345-0@lo:400:kworker.0 Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592819.004830:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788592819.004841:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788592819.004847:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1875475226046592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004876:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1875475226046592:12345-0@lo:400:kworker.0 Request processed in 28us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592819.004882:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788592819.004907:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226046080:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004917:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226046592:0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.004951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226045568 00000100:00100000:3.0:1788592819.004961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226045568 00000100:00100000:3.0:1788592819.004989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788592819.004995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226045568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592819.005030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226045568:12345-0@lo:400:kworker.0 Request processed in 35us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592819.005036:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788592819.005681:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226045568:0@lo:400:kworker.0 00000100:00080000:0.0:1788592819.005843:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592819.005860:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226045824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592819.005968:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226045824:12345-0@lo:400:kworker.0 Request processed in 4063us (5095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592819.005976:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00080000:3.0:1788592819.006043:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744774380 x1875475226045824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592819.006055:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226045824:0@lo:400:kworker.0 00000100:00080000:0.0:1788592819.006176:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592819.006333:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788592819.006344:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226046336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.006396:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226046336:12345-0@lo:400:kworker.0 Request processed in 55us (5476us total) trans 0 rc 0/0 00010000:00080000:0.0:1788592819.006456:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744775880 x1875475226046336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592819.006466:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226046336:0@lo:400:kworker.0 00000100:00100000:2.0:1788592819.006511:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00010000:3.0:1788592819.134045:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592819.520767:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226046848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592819.520845:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592819.520906:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046848 00000100:00100000:1.0:1788592819.520913:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046848 00000100:00100000:1.0:1788592819.520962:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788592819.520972:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226046848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592819.520994:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788592819.521046:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226046848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592819.521063:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788592819.521135:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226046848:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788592819.522944:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788592819.522965:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000004:00080000:2.0:1788592819.525128:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1788592819.525159:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1788592819.525183:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92186b9b9e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788592819.525188:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921849764100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92186b9b9480 00000020:00080000:2.0:1788592819.525191:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff921849764800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9218767c4c00 00000020:00080000:2.0:1788592819.525208:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1788592819.525228:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592819.525240:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592819.525248:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592819.525254:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592819.525260:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592819.525268:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592819.525284:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9218765df000) 00010000:00010000:2.0:1788592819.525287:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592819.525291:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592819.525298:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1a00/0xbd314a3362db5d30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788592819.525342:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788592819.525404:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788592819.526368:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226046976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788592819.526446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592819.526503:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226046976 00000100:00100000:1.0:1788592819.526510:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226046976 00000100:00100000:1.0:1788592819.526557:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592819.526566:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226046976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788592819.526689:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788592819.526694:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788592813 -> 1788592813 00002000:00010000:1.0:1788592819.526696:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788592813 -> 1788592813 00002000:00010000:1.0:1788592819.526699:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788592813 -> 1788592813 00002000:00010000:1.0:1788592819.526701:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788592819.526756:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226046976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (310us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788592819.526764:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788592819.526881:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788592819.526888:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92174477aa00, transno 4294967322 00000004:00080000:2.0:1788592819.526898:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788592819.526921:0:3640:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff92186d50a680 x1875475226046976/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788592835 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788592819.526932:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92186d50a680/2, rc 0, transno 4294967325 00000100:00100000:2.0:1788592819.526938:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226046976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788592820.024318:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226047104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592820.024391:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592820.024946:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226047232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592820.029331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592820.029458:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047104 00000100:00100000:1.0:1788592820.029467:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047104 00000100:00100000:1.0:1788592820.029591:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047232 00000100:00100000:1.0:1788592820.029595:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047232 00000100:00100000:2.0:1788592820.029684:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788592820.029698:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226047104:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592820.029709:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788592820.029724:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226047232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592820.029728:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788592820.029740:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592820.029800:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226047232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592820.029809:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788592820.029814:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226047104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (5421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592820.029823:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788592820.029953:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226047232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592820.029988:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226047104:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788592820.154061:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592820.905299:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592820.905401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209233664 00000100:00100000:3.0:1788592820.905411:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209233664 00000100:00100000:3.0:1788592820.905529:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 255 00000100:00100000:3.0:1788592820.905540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:12143:x1875475209233664:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788592820.905655:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:12143:x1875475209233664:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592820.905664:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 255 00000100:00080000:0.0:1788592820.905953:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592820.911014:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592820.911343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209233792 00000100:00100000:1.0:1788592820.911353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209233792 00000100:00100000:1.0:1788592820.911588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 256 00000100:00100000:1.0:1788592820.911613:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:12143:x1875475209233792:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788592820.911728:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:12143:x1875475209233792:12345-192.168.203.47@tcp:60:lhsmtool_posix.0 Request processed in 118us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592820.911736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 256 00000100:00080000:0.0:1788592820.911768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592820.915507:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592820.915603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234048 00000100:00100000:0.0:1788592820.915617:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234048 00000100:00100000:0.0:1788592820.915690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:0.0:1788592820.915700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:12143:x1875475209234048:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788592820.916371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:12143:x1875475209234048:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 671us (877us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788592820.916380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 65 00000100:00100000:2.0:1788592821.070844:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592821.070987:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234176 00000100:00100000:0.0:1788592821.070996:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234176 00000100:00100000:0.0:1788592821.071107:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 257 00000100:00100000:0.0:1788592821.071121:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:12957:x1875475209234176:12345-192.168.203.47@tcp:101:lsof.0 00010000:00010000:0.0:1788592821.071142:0:13208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592821.071162:0:13208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5dbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3156 expref: -99 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592821.071226:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5dc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592821.071240:0:13208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592821.071254:0:13208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788592821.071273:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788592821.071318:0:13208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592821.071322:0:13208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592821.073131:0:13208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592821.073177:0:13208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db5dbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3156 expref: 7 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592821.073198:0:13208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3156 expref: 6 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592821.073207:0:13208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:0.0:1788592821.073210:0:13208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592821.073214:0:13208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1600, rc 0) 00000100:00100000:0.0:1788592821.073437:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:12957:x1875475209234176:12345-192.168.203.47@tcp:101:lsof.0 Request processed in 2305us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592821.073451:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 257 00010000:00010000:3.0:1788592821.176492:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592821.178556:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592821.178598:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592821.178634:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592821.178732:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234432 00000100:00100000:3.0:1788592821.178754:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234432 00000100:00100000:3.0:1788592821.178819:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 127 00000100:00100000:2.0:1788592821.178826:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234304 00000100:00100000:3.0:1788592821.178833:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209234432:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592821.178833:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234304 00000100:00100000:2.0:1788592821.178874:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 381 00000100:00100000:2.0:1788592821.178882:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209234304:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592821.178950:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2396:x1875475209234432:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592821.178959:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 127 00000100:00080000:3.0:1788592821.178997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592821.179659:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234688 00000100:00100000:0.0:1788592821.179666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234688 00000100:00100000:0.0:1788592821.179712:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 288 00000100:00100000:0.0:1788592821.179720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209234688:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592821.180636:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209234304:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 1748us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592821.180648:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 381 00000100:00080000:2.0:1788592821.180722:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592821.180731:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592821.180836:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234560 00000100:00100000:1.0:1788592821.180842:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234560 00000100:00080000:2.0:1788592821.180880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592821.180888:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:1.0:1788592821.180898:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209234560:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592821.180963:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2395:x1875475209234560:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592821.180970:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:0.0:1788592821.189308:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2396:x1875475209234688:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 9577us (10661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592821.189772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 288 00000100:00100000:3.0:1788592822.073865:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592822.073890:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226047360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592822.073956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592822.074329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047360 00000100:00100000:2.0:1788592822.074338:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047360 00000100:00100000:2.0:1788592822.074743:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788592822.074753:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226047360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592822.074786:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592822.074847:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226047360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592822.074868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788592822.074895:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226047360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592822.075446:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226047488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592822.075484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592822.075558:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047488 00000100:00100000:2.0:1788592822.075576:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047488 00000100:00100000:2.0:1788592822.075613:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788592822.075623:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226047488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592822.075646:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788592822.076095:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226047488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 472us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592822.076102:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788592822.076241:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226047488:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788592822.201468:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592823.226199:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592823.468830:0:14996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:20:22 (1788592822) 00000100:00100000:3.0:1788592824.120214:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226047616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592824.120281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592824.120319:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047616 00000100:00100000:0.0:1788592824.120327:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047616 00000100:00080000:3.0:1788592824.120364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592824.120382:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788592824.120392:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226047616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592824.120431:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788592824.120484:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875475226047616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592824.120491:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788592824.120557:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226047616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592824.127500:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226047744:0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.127570:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592824.127981:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047744 00000100:00100000:3.0:1788592824.127989:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047744 00000100:00100000:1.0:1788592824.128031:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592824.128041:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226048128:0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.128048:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788592824.128059:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226047744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.128114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592824.128137:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184533c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3642:x1875475226047744:12345-0@lo:400:kworker.0 Request processed in 79us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592824.128145:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788592824.128178:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226047872:0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.128213:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592824.128238:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592824.128245:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226048000:0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.128274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592824.128380:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226047744:0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.128415:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226048256:0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.128444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592824.128465:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226048768:0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.128492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592824.128513:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592824.128521:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226048640:0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.128547:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592824.128573:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226048512:0@lo:400:kworker.0 00000100:00100000:1.0:1788592824.128594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592824.129279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226047872 00000100:00100000:2.0:1788592824.129286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226047872 00000100:00100000:2.0:1788592824.129323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048256 00000100:00100000:2.0:1788592824.129327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048256 00000100:00100000:2.0:1788592824.129344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048512 00000100:00100000:2.0:1788592824.129348:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048512 00000100:00100000:2.0:1788592824.129377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788592824.129386:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226047872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.129417:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788592824.129429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226048256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.129452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226047872:12345-0@lo:400:kworker.0 Request processed in 67us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592824.129471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788592824.129483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226048256:12345-0@lo:400:kworker.0 Request processed in 57us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592824.129490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788592824.129497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226048512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.129532:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226048512:12345-0@lo:400:kworker.0 Request processed in 35us (937us total) trans 0 rc 0/0 00010000:00080000:1.0:1788592824.129554:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921844d4ea00 x1875475226048512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592824.129566:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226048512:0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.129821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788592824.129953:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048768 00000100:00100000:0.0:1788592824.129957:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048768 00000100:00100000:0.0:1788592824.129982:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048640 00000100:00100000:0.0:1788592824.129985:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048640 00000100:00100000:0.0:1788592824.130003:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788592824.130009:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226048768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130051:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226048768:12345-0@lo:400:kworker.0 Request processed in 42us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592824.130057:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788592824.130092:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788592824.130099:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226048640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130124:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226048640:12345-0@lo:400:kworker.0 Request processed in 26us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592824.130129:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788592824.130144:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048128 00000100:00100000:0.0:1788592824.130256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048128 00000100:00100000:0.0:1788592824.130280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048000 00000100:00100000:0.0:1788592824.130283:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048000 00000100:00100000:0.0:1788592824.130305:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788592824.130312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226048128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226048128:12345-0@lo:400:kworker.0 Request processed in 34us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592824.130352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788592824.130364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788592824.130370:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226048000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130408:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226048000:12345-0@lo:400:kworker.0 Request processed in 30us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592824.130414:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788592824.130465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226048640:0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130477:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226048256:0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130485:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226048768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130494:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226048128:0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130510:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592824.130519:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226049152:0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592824.130640:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049152 00000100:00100000:0.0:1788592824.130644:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049152 00000100:00100000:0.0:1788592824.130687:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788592824.130694:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226049152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592824.130730:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226049152:12345-0@lo:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592824.130743:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788592824.130784:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226049152:0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.131057:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788592824.131096:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226048384:0@lo:400:kworker.0 00000100:00080000:2.0:1788592824.131125:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592824.131130:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592824.131133:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592824.131134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592824.131154:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226048896:0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.131164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048384 00000100:00100000:2.0:1788592824.131167:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048384 00000100:00100000:3.0:1788592824.131177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592824.131194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226048896 00000100:00100000:2.0:1788592824.131197:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226048896 00000100:00100000:3.0:1788592824.131203:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226048000:0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.131216:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226047872:0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.131217:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788592824.131224:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226048384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.131231:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592824.131237:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226049024:0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.131256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226048384:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592824.131262:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592824.131262:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788592824.131274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049024 00000100:00100000:2.0:1788592824.131277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049024 00000100:00100000:3.0:1788592824.131284:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226048384:0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.131294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788592824.131300:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226048896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.131302:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788592824.131310:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226049024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592824.131334:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226048896:12345-0@lo:400:kworker.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592824.131335:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226049024:12345-0@lo:400:kworker.0 Request processed in 27us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592824.131340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788592824.131347:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1788592824.131355:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592824.131358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788592824.131372:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921844d4d180 x1875475226049024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592824.131382:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226049024:0@lo:400:kworker.0 00000100:00100000:3.0:1788592824.131392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226048896:0@lo:400:kworker.0 00010000:00010000:3.0:1788592824.248684:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592824.632221:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592824.632246:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592824.632314:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592824.632368:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049280 00000100:00100000:1.0:1788592824.632377:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049280 00000100:00100000:1.0:1788592824.632437:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788592824.632446:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226049280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592824.632468:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788592824.632512:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226049280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592824.632529:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788592824.632576:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788592825.144315:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226049408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592825.144446:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226049536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592825.144460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592825.144625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592825.145524:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049408 00000100:00100000:3.0:1788592825.145534:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049408 00000100:00100000:3.0:1788592825.145582:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049536 00000100:00100000:3.0:1788592825.145585:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049536 00000100:00100000:3.0:1788592825.145601:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788592825.145609:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226049408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592825.145636:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788592825.145690:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226049408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592825.145696:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788592825.145713:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788592825.145719:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226049536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788592825.145728:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788592825.146290:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226049408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592825.151764:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226049536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6037us (7130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592825.151776:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226049536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592825.151782:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:3.0:1788592825.272866:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788592825.659840:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788592825.660684:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788592825.660696:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788592825.660758:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788592825.660773:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788592826.009159:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592826.009281:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209234944 00000100:00100000:0.0:1788592826.009291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209234944 00000100:00100000:0.0:1788592826.009497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:0.0:1788592826.009510:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+18:13181:x1875475209234944:12345-192.168.203.47@tcp:35:umount.0 00000100:00100000:0.0:1788592826.010216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:13181:x1875475209234944:12345-192.168.203.47@tcp:35:umount.0 Request processed in 706us (1062us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788592826.010225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00080000:2.0:1788592826.010636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592826.015810:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592826.016562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209235200 00000100:00100000:2.0:1788592826.016574:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209235200 00000100:00100000:2.0:1788592826.016645:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:2.0:1788592826.016655:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+19:13181:x1875475209235200:12345-192.168.203.47@tcp:35:umount.0 00000100:00100000:2.0:1788592826.020091:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:13181:x1875475209235200:12345-192.168.203.47@tcp:35:umount.0 Request processed in 3412us (4264us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788592826.020106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:1.0:1788592826.026157:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592826.026349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209235456 00000100:00100000:0.0:1788592826.026359:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209235456 00000100:00100000:0.0:1788592826.026427:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:0.0:1788592826.026438:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921869698850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+20:13181:x1875475209235456:12345-192.168.203.47@tcp:35:umount.0 00000100:00100000:0.0:1788592826.026666:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921869698850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:13181:x1875475209235456:12345-192.168.203.47@tcp:35:umount.0 Request processed in 229us (517us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788592826.026674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:1.0:1788592826.033897:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592826.034979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209235712 00000100:00100000:0.0:1788592826.034992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209235712 00000100:00100000:0.0:1788592826.035058:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:0.0:1788592826.035085:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:13181:x1875475209235712:12345-192.168.203.47@tcp:35:umount.0 00000100:00100000:0.0:1788592826.035416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:13181:x1875475209235712:12345-192.168.203.47@tcp:35:umount.0 Request processed in 348us (1525us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788592826.035423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:3.0:1788592826.038439:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592826.038492:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592826.038537:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592826.038791:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209235840 00000100:00100000:1.0:1788592826.038805:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209235840 00000100:00100000:1.0:1788592826.038895:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209236096 00000100:00100000:1.0:1788592826.038899:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209236096 00000100:00100000:3.0:1788592826.038990:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209235968 00000100:00100000:3.0:1788592826.038995:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209235968 00000100:00100000:3.0:1788592826.039207:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:3.0:1788592826.039228:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+15:2395:x1875475209235840:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592826.039264:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592826.039288:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205ea00/0xbd314a3362db4d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2ca9 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.039311:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592826.039379:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+14:2395:x1875475209235840:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 151us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592826.039397:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:3.0:1788592826.039419:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:3.0:1788592826.039426:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffd9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+13:2395:x1875475209235968:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592826.039434:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592826.039443:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839000/0xbd314a3362db4cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2c6a expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.039452:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592826.039471:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffd9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fde4749-eba3-4045-af7c-c124eb85a251+12:2395:x1875475209235968:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 46us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592826.039477:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:1.0:1788592826.039790:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:1.0:1788592826.039799:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fde4749-eba3-4045-af7c-c124eb85a251+11:2395:x1875475209236096:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592826.039809:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592826.039820:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b81a00/0xbd314a3362db4fb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d82 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.039829:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592826.039851:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fde4749-eba3-4045-af7c-c124eb85a251+10:2395:x1875475209236096:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 54us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.039858:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:3.0:1788592826.046318:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592826.046412:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209236480 00000100:00100000:2.0:1788592826.046425:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209236480 00000100:00100000:2.0:1788592826.046510:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 81 00000100:00100000:2.0:1788592826.046523:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+7:2392:x1875475209236480:12345-192.168.203.47@tcp:9:umount.0 00000020:00000080:2.0:1788592826.046562:0:8590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db5327 00000020:00010000:2.0:1788592826.046572:0:8590:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9217439bf000: total 0 00000100:00080000:2.0:1788592826.046578:0:8590:0:(import.c:65:import_set_state_nolock()) ffff921845409800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788592826.046638:0:8590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788592826.046859:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2392:x1875475209236480:12345-192.168.203.47@tcp:9:umount.0 Request processed in 328us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592826.046869:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 81 00000020:00010000:2.0:1788592826.046897:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9217439bf000: total 0 00010000:00010000:2.0:1788592826.046952:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9217439bf000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788592826.047114:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a08bef1/0xbd314a3362db56e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f6c expref: 4 pid: 8590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.047160:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb4eab4/0xbd314a3362db5db5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c314f expref: 3 pid: 10091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.047177:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9217439bf000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788592826.047191:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592826.047194:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592826.047195:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592826.047911:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592826.051747:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592826.051854:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209236608 00000100:00100000:0.0:1788592826.051884:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209236608 00000100:00100000:0.0:1788592826.052009:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 82 00000100:00100000:0.0:1788592826.052023:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2392:x1875475209236608:12345-192.168.203.47@tcp:9:umount.0 00000020:00000080:0.0:1788592826.052062:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db50b8 00000100:00080000:0.0:1788592826.052115:0:8429:0:(import.c:65:import_set_state_nolock()) ffff92184ac5a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592826.052179:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788592826.052382:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+2:2392:x1875475209236608:12345-192.168.203.47@tcp:9:umount.0 Request processed in 363us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.052401:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 82 00010000:00010000:1.0:1788592826.053186:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592826.057199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592826.062211:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592826.062305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209237632 00000100:00100000:0.0:1788592826.062319:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209237632 00000100:00100000:0.0:1788592826.062421:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 258 00000100:00100000:0.0:1788592826.062434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+22:2392:x1875475209237632:12345-192.168.203.47@tcp:39:umount.0 00000020:00000080:0.0:1788592826.062479:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4cf2 00000020:00010000:0.0:1788592826.062499:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9217434f5800: total 0 00000100:00080000:0.0:1788592826.062505:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9217434f5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592826.062544:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788592826.062760:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+21:2392:x1875475209237632:12345-192.168.203.47@tcp:39:umount.0 Request processed in 328us (571us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788592826.062769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 258 00000020:00010000:1.0:1788592826.062882:0:7920:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9217434f5800: total 0 00010000:00010000:1.0:1788592826.062950:0:7920:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9217434f5800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788592826.063007:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592826.063034:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788592826.063046:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022aa00/0xbd314a3362db576b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f8f expref: 20 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063100:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592826.063104:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592826.063108:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821ca200/0xbd314a3362db55c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f1f expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063124:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:1.0:1788592826.063127:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592826.063131:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db5017 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d90 expref: 18 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063153:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592826.063155:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592826.063159:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820ee00/0xbd314a3362db5d76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c313a expref: 17 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063172:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592826.063175:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788592826.063178:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db5da0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3148 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063193:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:1.0:1788592826.063196:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788592826.063205:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f200/0xbd314a3362db508e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2dac expref: 15 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063244:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9218765de900) 00010000:00010000:1.0:1788592826.063247:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592826.063251:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820fa00/0xbd314a3362db5a58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3068 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063268:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592826.063271:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788592826.063275:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cbc00/0xbd314a3362db56d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f65 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063290:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:1.0:1788592826.063297:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592826.063301:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9218821cb200/0xbd314a3362db574f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f88 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063315:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921882176c00) 00010000:00010000:1.0:1788592826.063317:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592826.063321:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92188205f800/0xbd314a3362db5033 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d97 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063336:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff92184f8fa100) 00010000:00010000:1.0:1788592826.063338:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592826.063342:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185820e400/0xbd314a3362db56a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2f57 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063358:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff921743723600) 00010000:00010000:1.0:1788592826.063361:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592826.063372:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db5389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2e85 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063402:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff921742463400) 00010000:00010000:1.0:1788592826.063409:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592826.063416:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1e00/0xbd314a3362db5c96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3102 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.063433:0:7920:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9217434f5800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788592826.063454:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592826.063457:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592826.063459:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592826.072229:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592826.072336:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209237760 00000100:00100000:3.0:1788592826.072351:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209237760 00000100:00100000:2.0:1788592826.072535:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 259 00000100:00100000:2.0:1788592826.072550:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+5:2392:x1875475209237760:12345-192.168.203.47@tcp:39:umount.0 00000020:00000080:2.0:1788592826.072595:0:13208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4ceb 00000100:00080000:2.0:1788592826.072618:0:13208:0:(import.c:65:import_set_state_nolock()) ffff921742828000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788592826.072722:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1788592826.072764:0:13208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788592826.072765:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592826.072979:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fa053f8-dea8-45a9-81cb-9946b4fa9e00+3:2392:x1875475209237760:12345-192.168.203.47@tcp:39:umount.0 Request processed in 432us (764us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788592826.072988:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 259 00000100:00100000:3.0:1788592826.294371:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592826.294484:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592826.294738:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209238016 00000100:00100000:2.0:1788592826.294748:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209238016 00000100:00100000:1.0:1788592826.294949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209237888 00000100:00100000:1.0:1788592826.294964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209237888 00000100:00080000:3.0:1788592826.295111:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592826.295117:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592826.295232:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 295 00000100:00100000:2.0:1788592826.295248:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209238016:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592826.295306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 296 00000100:00100000:1.0:1788592826.295324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2395:x1875475209237888:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592826.295332:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2395:x1875475209238016:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 83us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592826.295357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 295 00000100:00100000:1.0:1788592826.295423:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2395:x1875475209237888:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 103us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.295434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 296 00010000:00010000:1.0:1788592826.296308:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592827.192827:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226049664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592827.192906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592827.193044:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049664 00000100:00100000:2.0:1788592827.193053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049664 00000100:00100000:2.0:1788592827.193139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788592827.193149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226049664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592827.193181:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788592827.193238:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226049664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592827.193245:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788592827.194126:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226049664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592827.197307:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226049792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592827.197394:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592827.197556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049792 00000100:00100000:2.0:1788592827.197565:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049792 00000100:00100000:2.0:1788592827.197624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788592827.197633:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226049792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592827.197668:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788592827.197728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226049792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592827.197736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788592827.197816:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226049792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788592827.320418:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592827.532188:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592827.532230:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592827.532434:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209238144 00000100:00100000:0.0:1788592827.532445:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209238144 00000100:00100000:0.0:1788592827.532507:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209238272 00000100:00100000:0.0:1788592827.532511:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209238272 00000100:00100000:0.0:1788592827.532542:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:0.0:1788592827.532552:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+11:2396:x1875475209238144:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592827.532582:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592827.532603:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839e00/0xbd314a3362db4dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cbe expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592827.532620:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592827.532669:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+10:2396:x1875475209238144:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 119us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592827.532676:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:0.0:1788592827.532693:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:0.0:1788592827.532699:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+9:2396:x1875475209238272:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592827.532707:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592827.532716:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839800/0xbd314a3362db4df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cef expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592827.532724:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592827.532741:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+8:2396:x1875475209238272:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 42us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592827.532747:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:2.0:1788592827.537314:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592827.538633:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209238400 00000100:00100000:0.0:1788592827.538659:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209238400 00000100:00100000:0.0:1788592827.539278:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:0.0:1788592827.539294:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+8:2393:x1875475209238400:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592827.539315:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592827.539342:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80e00/0xbd314a3362db4fae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2d7b expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592827.539363:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592827.539480:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fde4749-eba3-4045-af7c-c124eb85a251+7:2393:x1875475209238400:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 190us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592827.539489:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:3.0:1788592827.550283:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592827.550593:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209238656 00000100:00100000:0.0:1788592827.550606:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209238656 00000100:00100000:0.0:1788592827.550727:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 260 00000100:00100000:0.0:1788592827.550741:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+6:2392:x1875475209238656:12345-192.168.203.47@tcp:39:umount.0 00000020:00000080:0.0:1788592827.550795:0:10029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4e03 00000020:00010000:0.0:1788592827.550808:0:10029:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9217438b0800: total 0 00000100:00080000:0.0:1788592827.550814:0:10029:0:(import.c:65:import_set_state_nolock()) ffff9217438b5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592827.550852:0:10029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788592827.551123:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2392:x1875475209238656:12345-192.168.203.47@tcp:39:umount.0 Request processed in 384us (853us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788592827.551133:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 260 00000020:00010000:3.0:1788592827.551201:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9217438b0800: total 0 00010000:00010000:3.0:1788592827.551207:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592827.551273:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9217438b0800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788592827.551317:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921859546c00) 00010000:00010000:3.0:1788592827.551321:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592827.551332:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db5dc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3156 expref: 4 pid: 13208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592827.551394:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9217438b0800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788592827.551407:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592827.551409:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592827.551411:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592827.558935:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592827.559118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209238784 00000100:00100000:1.0:1788592827.559131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209238784 00000100:00100000:1.0:1788592827.559204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 261 00000100:00100000:1.0:1788592827.559215:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+5:2392:x1875475209238784:12345-192.168.203.47@tcp:39:umount.0 00000020:00000080:1.0:1788592827.559269:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4e0a 00000100:00080000:1.0:1788592827.559299:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9218767b6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788592827.559350:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788592827.559530:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592827.559569:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9ab9d447-3b18-4e16-9fd8-b554c1995bd0+3:2392:x1875475209238784:12345-192.168.203.47@tcp:39:umount.0 Request processed in 354us (647us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788592827.559577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 261 00000100:00100000:1.0:1788592827.590486:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592827.590610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239040 00000100:00100000:2.0:1788592827.590624:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239040 00000100:00100000:2.0:1788592827.590697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 383 00000100:00100000:2.0:1788592827.590709:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+7:2392:x1875475209239040:12345-192.168.203.47@tcp:251:umount.0 00000020:00000080:2.0:1788592827.590770:0:6505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4cc8 00000020:00010000:2.0:1788592827.590780:0:6505:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92186f49d800: total 0 00000100:00080000:2.0:1788592827.590785:0:6505:0:(import.c:65:import_set_state_nolock()) ffff92186f49b800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788592827.590910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218430e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fde4749-eba3-4045-af7c-c124eb85a251+3:2392:x1875475209239040:12345-192.168.203.47@tcp:251:umount.0 Request processed in 203us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592827.590920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 383 00000020:00010000:1.0:1788592827.591323:0:7920:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92186f49d800: total 0 00010000:00010000:1.0:1788592827.591405:0:7920:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92186f49d800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788592827.591451:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205e400/0xbd314a3362db4d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c2cb0 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592827.591469:0:7920:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92186f49d800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788592827.591480:0:7920:0:(genops.c:885:class_export_put()) final put ffff92186f49d800/9fde4749-eba3-4045-af7c-c124eb85a251 00010000:00010000:1.0:1788592827.591494:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592827.591497:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592827.591498:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788592827.591710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92186f49d800/9fde4749-eba3-4045-af7c-c124eb85a251 for MGS 00000020:00000080:2.0:1788592827.591753:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92186f49b800 for MGS 00010000:00010000:3.0:1788592828.353633:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592828.800968:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592828.800980:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592828.801099:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788592828.801106:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788592828.921923:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788592829.063802:0:15192:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788592829.080474:0:15192:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788592829.080552:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592829.080573:0:15192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592829.080581:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592829.080726:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592829.080750:0:15192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788592829.080757:0:15192:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788592829.080816:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592829.080825:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.080833:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80800 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592829.080837:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.080847:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592829.080855:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592829.080861:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788592829.080864:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788592829.080867:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788592829.080913:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.080921:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788592829.081017:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592829.081024:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788592829.081032:0:15192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788592829.081049:0:15192:0:(import.c:65:import_set_state_nolock()) ffff921848c6d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788592829.081136:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475226050048:0@lo:39:umount.0 00000100:00100000:1.0:1788592829.081233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592829.081350:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050048 00000100:00100000:1.0:1788592829.081360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050048 00000100:00100000:1.0:1788592829.081431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788592829.081443:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875475226050048:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788592829.081476:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db48df 00000100:00080000:1.0:1788592829.081487:0:6512:0:(import.c:65:import_set_state_nolock()) ffff92184f8bf800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788592829.081556:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1875475226050048:12345-0@lo:39:umount.0 Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592829.081564:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1788592829.081575:0:6512:0:(genops.c:885:class_export_put()) final put ffff92184f8bd000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788592829.081612:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592829.081625:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92184f8bd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788592829.081680:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92184f8bf800 for lustre-MDT0000 00010000:00010000:2.0:1788592829.081706:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592829.081707:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226049920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592829.081721:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80800/0xbd314a3362db4d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d85 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.081736:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592829.081738:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592829.081740:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592829.081760:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592829.081787:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226049920 00000100:00100000:2.0:1788592829.081793:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226049920 00000100:00080000:1.0:1788592829.081828:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921848c6d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788592829.081840:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788592829.081843:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475226050048:0@lo:39:umount.0 00000100:00100000:2.0:1788592829.081853:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3639:x1875475226049920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592829.081868:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592829.081887:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742838c00/0xbd314a3362db4d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d7e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788592829.081892:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592829.081897:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00010000:00010000:2.0:1788592829.081902:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592829.081902:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788592829.082008:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3639:x1875475226049920:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592829.082016:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592829.082045:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226049920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592829.082976:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.082990:0:15192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.082998:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083007:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083036:0:15192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592829.083043:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083051:0:15192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592829.083105:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592829.083118:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592829.083139:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838a00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592829.083143:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592829.083152:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592829.083159:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592829.083165:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592829.083168:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788592829.083198:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592829.083204:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592829.083233:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592829.083240:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742838a00/0xbd314a3362db4d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592829.083252:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592829.083254:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592829.083256:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592829.083404:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592829.083413:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226050176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592829.083414:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592829.083481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592829.083673:0:15192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592829.083681:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592829.083686:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083695:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592829.083699:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083708:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592829.083717:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592829.083724:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788592829.083727:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788592829.083730:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788592829.083751:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083758:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592829.083777:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083793:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921840030600/0xbd314a3362db4c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4c89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083809:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592829.083812:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592829.083814:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592829.083827:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226050304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592829.083874:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083884:0:15192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083891:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083898:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083913:0:15192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592829.083920:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083928:0:15192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083935:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083952:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.083964:0:15192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788592829.083968:0:15192:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788592829.083971:0:15192:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788592829.084005:0:15192:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788592829.084010:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788592829.084016:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592829.084022:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788592829.084029:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9217434f7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592829.084037:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff921742495800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592829.084043:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92187c85e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592829.084048:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92187c858800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788592829.084058:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9217438b0800 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 192.168.203.47@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592829.084064:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9217434f5800 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 192.168.203.47@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1788592829.084097:0:15192:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff92186b9f8000) has exports, disconnecting them 00000020:00080000:1.0:1788592829.084103:0:15192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9217434f7800), last request at 1788592824 00000020:00000080:1.0:1788592829.084112:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4bef 00000100:00080000:1.0:1788592829.084131:0:15192:0:(import.c:65:import_set_state_nolock()) ffff9217434f3000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788592829.084176:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592829.084182:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084190:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ec00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592829.084200:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084209:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592829.084217:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592829.084226:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788592829.084230:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788592829.084234:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788592829.084256:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084268:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592829.084280:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084287:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db4fe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4fed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084300:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592829.084304:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084310:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9218821ca000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592829.084314:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.084322:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592829.084336:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592829.084343:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788592829.084346:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788592829.084348:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788592829.084758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592829.085009:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.085020:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592829.085043:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592829.085051:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9218821ca000/0xbd314a3362db483e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4845 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592829.085113:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226050560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592829.085162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788592829.085478:0:15192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9217434f7800): rc 0 00000020:00000080:0.0:1788592829.085482:0:15192:0:(genops.c:885:class_export_put()) final put ffff9217434f7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788592829.085496:0:15192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff921742495800), last request at 1788592824 00000020:00000080:0.0:1788592829.085503:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4ac9 00000100:00080000:0.0:1788592829.085513:0:15192:0:(import.c:65:import_set_state_nolock()) ffff921742494800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788592829.085529:0:15192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff921742495800): rc 0 00000020:00000080:0.0:1788592829.085531:0:15192:0:(genops.c:885:class_export_put()) final put ffff921742495800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788592829.085536:0:15192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92187c85e000), last request at 1788592637 00000020:00000080:0.0:1788592829.085540:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4a05 00000100:00080000:0.0:1788592829.085544:0:15192:0:(import.c:65:import_set_state_nolock()) ffff92187c85e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788592829.085550:0:15192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92187c85e000): rc 0 00000020:00000080:0.0:1788592829.085552:0:15192:0:(genops.c:885:class_export_put()) final put ffff92187c85e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788592829.085557:0:15192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92187c858800), last request at 1788592637 00000020:00000080:0.0:1788592829.085560:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db49cd 00000100:00080000:0.0:1788592829.085563:0:15192:0:(import.c:65:import_set_state_nolock()) ffff92187d594800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592829.085571:0:15192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1788592829.085654:0:15192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92187c858800): rc 0 00000004:00000080:0.0:1788592829.085661:0:15192:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb76c81607ae0 00000100:00080000:0.0:1788592829.085684:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788592829.085688:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788592829.085699:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592829.085703:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592829.085705:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592829.085720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9217434f7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788592829.085773:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff921742495800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788592829.085808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c85e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788592829.085843:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217434f3000 for lustre-MDT0000 00000020:00000080:1.0:1788592829.085849:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921742494800 for lustre-MDT0000 00000020:00000080:1.0:1788592829.085854:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92187c85e800 for lustre-MDT0000 00010000:00010000:1.0:1788592829.085880:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592829.085913:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226050432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592829.085956:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592829.086727:0:15192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788592829.086757:0:15192:0:(import.c:65:import_set_state_nolock()) ffff92187c85f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788592829.086815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226050688:0@lo:39:umount.0 00000100:00100000:0.0:1788592829.086862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592829.086919:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788592829.087348:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788592829.087357:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788592829.087406:0:15192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788592829.087486:0:15192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788592829.087519:0:15192:0:(import.c:65:import_set_state_nolock()) ffff9218765fc800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788592829.087545:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788592829.087548:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:0.0:1788592829.087560:0:15192:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff92186d50a680 x1875475226046976/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788592835 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788592829.087571:0:15192:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92186d50a680, transno 4294967325 00000004:00080000:0.0:1788592829.087603:0:15192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788592829.088353:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226050816:0@lo:9:umount.0 00000100:00100000:0.0:1788592829.088435:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592829.088488:0:15192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788592829.088501:0:15192:0:(import.c:65:import_set_state_nolock()) ffff921876712000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788592829.088520:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226050944:0@lo:9:umount.0 00000100:00100000:0.0:1788592829.088543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788592829.088623:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92186b9f8000) has no exports 00000100:00100000:0.0:1788592829.088947:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050688 00000100:00100000:0.0:1788592829.088955:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050688 00000100:00100000:0.0:1788592829.089001:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788592829.089009:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875475226050688:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788592829.089034:0:7782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4a13 00000100:00080000:0.0:1788592829.089041:0:7782:0:(import.c:65:import_set_state_nolock()) ffff9218766ac800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592829.089064:0:7782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788592829.089388:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3638:x1875475226050688:12345-0@lo:39:umount.0 Request processed in 378us (2524us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788592829.089411:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1788592829.089455:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c85f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788592829.089462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226050688:0@lo:39:umount.0 00000100:00100000:0.0:1788592829.089488:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592829.090191:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050176 00000100:00100000:3.0:1788592829.090207:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050176 00000100:00100000:1.0:1788592829.090242:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050560 00000100:00100000:1.0:1788592829.090249:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050560 00000100:00100000:3.0:1788592829.090293:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050432 00000100:00100000:3.0:1788592829.090299:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050432 00000100:00100000:2.0:1788592829.090627:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592829.090655:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+25:3640:x1875475226050176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592829.090676:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592829.090700:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839600/0xbd314a3362db4d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d8c expref: 25 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.090722:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592829.090794:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+24:3640:x1875475226050176:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (7314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592829.090803:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592829.090823:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592829.090829:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+23:3639:x1875475226050560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592829.090837:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592829.090846:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b520800/0xbd314a3362db4845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db483e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.090856:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592829.090886:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+22:3639:x1875475226050560:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592829.090892:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592829.090907:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592829.090913:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+21:3642:x1875475226050432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592829.090920:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592829.090929:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f600/0xbd314a3362db4fed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4fe6 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592829.091014:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592829.091042:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3642:x1875475226050432:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (5086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592829.091056:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592829.091184:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3640:1875475226050176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592829.091221:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592829.091268:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226050432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592829.091312:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050816 00000100:00100000:3.0:1788592829.091324:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050816 00000100:00100000:3.0:1788592829.091381:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050944 00000100:00100000:3.0:1788592829.091385:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050944 00000100:00100000:3.0:1788592829.091408:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788592829.091416:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875475226050816:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788592829.091443:0:8590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b71 00000100:00080000:3.0:1788592829.091452:0:8590:0:(import.c:65:import_set_state_nolock()) ffff92186f49f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592829.091506:0:8590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788592829.091663:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3638:x1875475226050816:12345-0@lo:9:umount.0 Request processed in 247us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592829.091670:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788592829.091683:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788592829.091689:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875475226050944:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788592829.091702:0:8590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4cb3 00000100:00080000:3.0:1788592829.091708:0:8590:0:(import.c:65:import_set_state_nolock()) ffff9217434f6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592829.091730:0:8590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788592829.091807:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3638:x1875475226050944:12345-0@lo:9:umount.0 Request processed in 118us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592829.091813:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788592829.091859:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592829.091863:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788592829.091870:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592829.091912:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226050560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592829.092104:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00080000:3.0:1788592829.092113:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921876712000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788592829.092130:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788592829.092132:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788592829.092135:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226050944:0@lo:9:umount.0 00000100:00080000:3.0:1788592829.092170:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fc800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788592829.092182:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788592829.092184:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788592829.092188:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226050816:0@lo:9:umount.0 00010000:00010000:0.0:1788592829.092216:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592829.092241:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226050304 00000100:00100000:0.0:1788592829.092251:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226050304 00000100:00100000:0.0:1788592829.092324:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592829.092340:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92184ffdac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+20:3641:x1875475226050304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592829.092356:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592829.092392:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841495200/0xbd314a3362db4c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4c82 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592829.092415:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592829.092490:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92184ffdac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3641:x1875475226050304:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592829.092502:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592829.092547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3641:1875475226050304:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788592829.099488:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92186b9f8000) has no exports 00000020:00000080:1.0:1788592829.138797:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4899 00000020:00000080:1.0:1788592829.138813:0:15192:0:(genops.c:885:class_export_put()) final put ffff92187594c800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788592829.138893:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788592829.138966:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592829.138977:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788592829.138981:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff921851283380) has no exports 00000020:00000080:2.0:1788592829.139351:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92187594c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788592829.139380:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4892 00000020:00000080:1.0:1788592829.139388:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218758fc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788592829.139458:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592829.139465:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788592829.139468:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218758f9800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788592829.139470:0:15192:0:(genops.c:844:class_export_destroy()) destroying export ffff9218758f9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788592829.139477:0:15192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788592829.139689:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9218758fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788592829.240570:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226051072:0@lo:400:kworker.0 00000100:00100000:0.0:1788592829.240663:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226051456:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.240681:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592829.240701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592829.240759:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051072 00000100:00100000:2.0:1788592829.240770:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051072 00000100:00100000:1.0:1788592829.240797:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226051328:0@lo:400:kworker.0 00000100:00100000:2.0:1788592829.240823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788592829.240846:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226051968:0@lo:400:kworker.0 00000100:00100000:2.0:1788592829.240886:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875475226051072:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788592829.240895:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788592829.241231:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226051584:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.241264:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592829.241300:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051584 00000100:00100000:3.0:1788592829.241304:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051584 00000100:00100000:3.0:1788592829.241353:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788592829.241361:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226051584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.241421:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226051584:12345-0@lo:400:kworker.0 Request processed in 62us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592829.241428:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788592829.241452:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592829.241492:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226051584:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.241553:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051456 00000100:00100000:3.0:1788592829.241558:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051456 00000100:00100000:3.0:1788592829.241593:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788592829.241599:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226051456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.241632:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226051456:12345-0@lo:400:kworker.0 Request processed in 34us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592829.241638:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788592829.241810:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592829.241967:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051328 00000100:00100000:3.0:1788592829.241972:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051328 00000100:00100000:3.0:1788592829.242013:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788592829.242017:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875475226051328:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788592829.242023:0:10029:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788592829.242052:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875475226051328:12345-0@lo:400:kworker.0 Request processed in 34us (242us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788592829.242059:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1788592829.242107:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592829.242203:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788592829.242210:0:3642:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788592829.242214:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788592829.243275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788592829.243357:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d508e00 x1875475226051456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592829.243382:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226051456:0@lo:400:kworker.0 00000100:00100000:0.0:1788592829.243453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226051200:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.243468:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051968 00000100:00100000:3.0:1788592829.243474:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051968 00000100:00100000:0.0:1788592829.243505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592829.243526:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226051712:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.243527:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788592829.243535:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226051968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592829.243548:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592829.243581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051200 00000100:00100000:0.0:1788592829.243585:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051200 00000100:00100000:3.0:1788592829.243587:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226051968:12345-0@lo:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592829.243594:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788592829.243608:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051712 00000100:00100000:0.0:1788592829.243611:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051712 00000100:00080000:3.0:1788592829.243617:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592829.243627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788592829.243631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875475226051200:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788592829.243638:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788592829.243641:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788592829.243670:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875475226051200:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788592829.243705:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875475226051712:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788592829.243711:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788592829.243737:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875475226051712:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788592829.243747:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788592829.243750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788592829.243778:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788592829.243783:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9218765fd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788592829.243787:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788592829.243793:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9218765fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592829.243797:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 171 00000100:00080000:0.0:1788592829.243804:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9218765fd800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592829.243836:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921844d4d880 x1875475226052096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592829.243866:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226051200:0@lo:400:kworker.0 00000100:00080000:0.0:1788592829.243878:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788592829.243881:0:3641:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788592829.243884:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788592829.243893:0:3641:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592829.243897:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 206 00000100:00080000:0.0:1788592829.243901:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff921742497800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592829.243914:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921844d4f100 x1875475226052224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592829.243925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1875475226051712:0@lo:400:kworker.0 00000100:00100000:0.0:1788592829.243955:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226051968:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.245233:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475226052096:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788592829.245298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592829.245339:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226052224:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788592829.245362:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592829.245444:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875475226051072:12345-0@lo:400:kworker.0 Request processed in 4558us (4762us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788592829.245471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1788592829.245527:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788592829.245533:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9218696bc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788592829.245536:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788592829.245542:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9218696bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592829.245547:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 171 00000100:00080000:3.0:1788592829.245554:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9218696bc000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592829.245587:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875b20e00 x1875475226052352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788592829.245608:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226051072:0@lo:400:kworker.0 00000100:00100000:3.0:1788592829.245635:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226052352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788592829.245663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592829.245694:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052352 00000100:00100000:3.0:1788592829.245700:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052352 00000100:00100000:3.0:1788592829.245730:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788592829.245737:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875475226052352:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788592829.245755:0:6518:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788592829.245828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052096 00000100:00100000:0.0:1788592829.245833:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052096 00000100:00100000:0.0:1788592829.245862:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052224 00000100:00100000:0.0:1788592829.245865:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052224 00000100:00100000:0.0:1788592829.245883:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788592829.245887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226052096:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788592829.245895:0:6513:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788592829.245938:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226052096:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (640us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788592829.245944:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788592829.245959:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788592829.245963:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226052224:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788592829.245970:0:6513:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788592829.245993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226052224:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28us (630us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788592829.245999:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788592829.246032:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592829.246037:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788592829.246049:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475226052096:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788592829.246062:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592829.246093:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788592829.246096:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226052224:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788592829.273644:0:3642:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592829.273657:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 188 00000100:00080000:1.0:1788592829.273667:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92187d590800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592829.273708:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744557100 x1875475226052480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592829.273747:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226051328:0@lo:400:kworker.0 00000100:00100000:1.0:1788592829.273756:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226051840:0@lo:400:kworker.0 00000100:00100000:0.0:1788592829.273827:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226052480:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788592829.273924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592829.275712:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052480 00000100:00100000:1.0:1788592829.275726:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592829.275731:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052480 00000100:00100000:0.0:1788592829.275791:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226051840 00000100:00100000:0.0:1788592829.275796:0:10029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226051840 00000100:00100000:0.0:1788592829.275863:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788592829.275875:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226051840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592829.275975:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226051840:12345-0@lo:400:kworker.0 Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592829.275983:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788592829.276006:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788592829.276010:0:10029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875475226052480:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788592829.276030:0:10029:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788592829.276092:0:10029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875475226052480:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 80us (2171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788592829.276099:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788592829.276156:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592829.276164:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1788592829.276169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592829.276171:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226052480:0@lo:38:ptlrpcd_00_03.0 00010000:00080000:1.0:1788592829.276234:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186d508700 x1875475226051840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592829.276250:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226051840:0@lo:400:kworker.0 00000100:00100000:2.0:1788592829.280887:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875475226052352:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 35143us (35215us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592829.280902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1788592829.281209:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218696bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592829.281215:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788592829.281220:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226052352:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788592829.369103:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592829.752290:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592829.753520:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226052608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592829.753654:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592829.754087:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052608 00000100:00100000:1.0:1788592829.754096:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052608 00000100:00100000:1.0:1788592829.754203:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788592829.754214:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226052608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592829.754245:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788592829.754305:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226052608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592829.754312:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788592829.754400:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226052608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592830.264450:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226052736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592830.264527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592830.264591:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052736 00000100:00100000:3.0:1788592830.264611:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052736 00000100:00100000:3.0:1788592830.264663:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788592830.264672:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226052736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788592830.264701:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592830.266000:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226052736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592830.266461:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226052736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1789us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592830.266471:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:3.0:1788592830.393532:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592831.416568:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788592831.806313:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592831.806321:0:6491:0:(genops.c:885:class_export_put()) final put ffff92187c858800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788592831.806366:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00080000:3.0:1788592831.806373:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788592831.806376:0:6491:0:(genops.c:885:class_export_put()) final put ffff9217438b0800/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00100000:3.0:1788592831.806381:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000001:00080000:3.0:1788592831.806384:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788592831.806391:0:6491:0:(genops.c:885:class_export_put()) final put ffff9217434f5800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:2.0:1788592831.806460:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c858800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788592831.806512:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9217438b0800/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 for lustre-MDT0000 00000020:00000080:2.0:1788592831.806534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9217434f5800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-MDT0000 00000020:00000080:2.0:1788592831.806569:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92187d594800 for lustre-MDT0000 00000020:00000080:2.0:1788592831.806574:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217438b5000 for lustre-MDT0000 00000020:00000080:2.0:1788592831.806577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217434f5000 for lustre-MDT0000 00000001:00100000:1.0:1788592831.807149:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788592831.807153:0:8422:0:(genops.c:885:class_export_put()) final put ffff92186f498000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788592831.807172:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:1.0:1788592831.807175:0:8422:0:(genops.c:885:class_export_put()) final put ffff92184ac59000/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:2.0:1788592831.807221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92186f498000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788592831.808035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92184ac59000/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-OST0000 00000020:00000080:2.0:1788592831.808172:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92186f49f800 for lustre-OST0000 00000020:00000080:2.0:1788592831.808177:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92184ac5a000 for lustre-OST0000 00000001:00100000:0.0:1788592831.808640:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788592831.808646:0:9505:0:(genops.c:885:class_export_put()) final put ffff9217434f3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788592831.808671:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:0.0:1788592831.808674:0:9505:0:(genops.c:885:class_export_put()) final put ffff9217439bf000/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000001:00100000:3.0:1788592831.808761:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788592831.808771:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788592831.808775:0:7443:0:(genops.c:885:class_export_put()) final put ffff92187c85c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788592831.808781:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00080000:3.0:1788592831.808787:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788592831.808788:0:7443:0:(genops.c:885:class_export_put()) final put ffff9218767b7000/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 00000001:00100000:3.0:1788592831.808792:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000001:00080000:3.0:1788592831.808795:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788592831.808797:0:7443:0:(genops.c:885:class_export_put()) final put ffff921742829800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 00000020:00000080:2.0:1788592831.809193:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9217434f3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788592831.809232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9217439bf000/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-OST0001 00000020:00000080:2.0:1788592831.809254:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c85c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788592831.809302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9218767b7000/9ab9d447-3b18-4e16-9fd8-b554c1995bd0 for lustre-MDT0001 00000020:00000080:2.0:1788592831.809323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff921742829800/7fa053f8-dea8-45a9-81cb-9946b4fa9e00 for lustre-MDT0001 00000020:00000080:2.0:1788592831.809357:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217434f6000 for lustre-OST0001 00000020:00000080:2.0:1788592831.809362:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921845409800 for lustre-OST0001 00000020:00000080:2.0:1788592831.809366:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9218766ac800 for lustre-MDT0001 00000020:00000080:2.0:1788592831.809369:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9218767b6800 for lustre-MDT0001 00000020:00000080:2.0:1788592831.809372:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921742828000 for lustre-MDT0001 00010000:00010000:1.0:1788592832.440403:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592833.465540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592834.360382:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592834.360388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788592834.360392:0:37:0:(import.c:65:import_set_state_nolock()) ffff9218696bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592834.360400:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 363 00000100:00080000:3.0:1788592834.360405:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592834.360427:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9218696bc000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592834.360449:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875b23b80 x1875475226052992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592834.360474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592834.360478:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788592834.360479:0:37:0:(import.c:65:import_set_state_nolock()) ffff9218765fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592834.360483:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 363 00000100:00080000:3.0:1788592834.360485:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592834.360489:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9218765fd800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592834.360502:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875b20e00 x1875475226053120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592834.360511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592834.360514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788592834.360515:0:37:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592834.360519:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 363 00000100:00080000:3.0:1788592834.360521:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592834.360524:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92187d590800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592834.360534:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921875b20380 x1875475226053248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592834.360564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592834.360567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788592834.360568:0:37:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592834.360572:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 363 00000100:00080000:3.0:1788592834.360574:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592834.360583:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff921742497800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592834.360595:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360df80 x1875475226053632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788592834.360639:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226053504:0@lo:400:kworker.0 00000100:00100000:3.0:1788592834.360705:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592834.360900:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592834.360968:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226053376:0@lo:400:kworker.0 00000100:00100000:3.0:1788592834.360997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592834.361133:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226052992:0@lo:38:kworker.0 00000100:00100000:2.0:1788592834.361165:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592834.361202:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475226053120:0@lo:38:kworker.0 00000100:00100000:2.0:1788592834.361225:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592834.361244:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226053248:0@lo:38:kworker.0 00000100:00100000:2.0:1788592834.361264:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592834.361283:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226053632:0@lo:38:kworker.0 00000100:00100000:2.0:1788592834.361302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592834.361328:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053376 00000100:00100000:2.0:1788592834.361347:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053376 00000100:00100000:2.0:1788592834.361394:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053120 00000100:00100000:2.0:1788592834.361398:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053120 00000100:00100000:2.0:1788592834.361407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053248 00000100:00100000:2.0:1788592834.361409:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053248 00000100:00100000:2.0:1788592834.361415:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053632 00000100:00100000:2.0:1788592834.361418:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053632 00000100:00100000:2.0:1788592834.361428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788592834.361438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226053376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592834.361485:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226053376:12345-0@lo:400:kworker.0 Request processed in 50us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592834.361504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788592834.361520:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788592834.361524:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475226053120:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788592834.361538:0:6512:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788592834.362273:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053504 00000100:00100000:3.0:1788592834.362281:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053504 00000100:00100000:3.0:1788592834.362340:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592834.362348:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226053504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592834.362390:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226053504:12345-0@lo:400:kworker.0 Request processed in 43us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592834.362396:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592834.362418:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052992 00000100:00100000:3.0:1788592834.362422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052992 00000100:00100000:3.0:1788592834.362441:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788592834.362446:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226052992:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788592834.362455:0:6517:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788592834.362489:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226052992:12345-0@lo:38:kworker.0 Request processed in 42us (1323us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592834.362495:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1788592834.362531:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218696bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592834.362536:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788592834.362540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226052992:0@lo:38:kworker.0 00000100:00100000:3.0:1788592834.362590:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788592834.362594:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1875475226053248:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788592834.362601:0:13208:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788592834.362632:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1875475226053248:12345-0@lo:38:kworker.0 Request processed in 36us (1367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592834.362638:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788592834.362651:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788592834.362655:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1875475226053632:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788592834.362661:0:13208:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788592834.362684:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1875475226053632:12345-0@lo:38:kworker.0 Request processed in 27us (1381us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592834.362689:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1788592834.362715:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592834.362720:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788592834.362722:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226053248:0@lo:38:kworker.0 00000100:00080000:3.0:1788592834.362731:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592834.362735:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788592834.362738:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226053632:0@lo:38:kworker.0 00000100:00100000:0.0:1788592834.362929:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921875b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226052864:0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.362968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592834.362994:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226052864 00000100:00100000:0.0:1788592834.362998:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226052864 00000100:00100000:0.0:1788592834.363042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788592834.363049:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3642:x1875475226052864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363101:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921878df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2+19:3642:x1875475226052864:12345-0@lo:400:kworker.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592834.363107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788592834.363151:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226052864:0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363158:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226053888:0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592834.363368:0:8590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053888 00000100:00100000:0.0:1788592834.363371:0:8590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053888 00000100:00100000:0.0:1788592834.363400:0:8590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788592834.363406:0:8590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226053888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363443:0:8590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226053888:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592834.363449:0:8590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788592834.363476:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226053888:0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363490:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592834.363496:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226053760:0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592834.363540:0:13208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226053760 00000100:00100000:0.0:1788592834.363543:0:13208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226053760 00000100:00100000:0.0:1788592834.363569:0:13208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788592834.363575:0:13208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226053760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592834.363602:0:13208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226053760:12345-0@lo:400:kworker.0 Request processed in 27us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592834.363608:0:13208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00080000:0.0:1788592834.363634:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360c700 x1875475226053760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592834.363644:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226053760:0@lo:400:kworker.0 00000100:00080000:1.0:1788592834.364090:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592834.364094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592834.364097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788592834.364423:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360e680 x1875475226053376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592834.364435:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226053376:0@lo:400:kworker.0 00000100:00100000:3.0:1788592834.364448:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226053504:0@lo:400:kworker.0 00000100:00100000:2.0:1788592834.372124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475226053120:12345-0@lo:38:kworker.0 Request processed in 10589us (10889us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592834.372137:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1788592834.372584:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592834.372590:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788592834.372607:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921875b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475226053120:0@lo:38:kworker.0 00010000:00010000:0.0:1788592834.488475:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592834.872302:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592834.872337:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226054016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592834.872408:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592834.872499:0:10702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054016 00000100:00100000:1.0:1788592834.872518:0:10702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054016 00000100:00100000:1.0:1788592834.872587:0:10702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788592834.872597:0:10702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226054016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592834.872627:0:10702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788592834.872675:0:10702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226054016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592834.872682:0:10702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788592834.872929:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226054016:0@lo:13:osp-pre-1-1.0 00000020:01000000:1.0:1788592835.192684:0:15192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92184feb7180 - data ffff921878b09af8/ffff921875b7c400 00000020:01000000:1.0:1788592835.192842:0:15192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff921875a81c00 - data ffff921878943bd0/ffff921875aa5800 00000001:00000004:1.0:1788592835.204305:0:15192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1788592835.266482:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788592835.266491:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788592835.266506:0:15192:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff921844d4ce00 x1875475226050688/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788592839 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592835.266528:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788592835.270634:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788592835.270643:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788592835.270673:0:15192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788592835.270676:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788592835.273186:0:8588:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788592835.273195:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788592835.273209:0:8588:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788592835.274217:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788592835.274222:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788592835.274244:0:15192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788592835.274247:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788592835.274858:0:10032:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788592835.274863:0:10032:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:2.0:1788592835.274873:0:10032:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788592835.275653:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4861 00000020:00000080:1.0:1788592835.275663:0:15192:0:(genops.c:885:class_export_put()) final put ffff921871435800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592835.275732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921871435800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788592835.279377:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4876 00000020:00000080:1.0:1788592835.279392:0:15192:0:(genops.c:885:class_export_put()) final put ffff921871437800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788592835.279401:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788592835.279406:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592835.279414:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788592835.279418:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff92186b9fcd40) has no exports 00000004:01000000:1.0:1788592835.279586:0:15192:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788592835.279596:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4cac 00000020:00000080:1.0:1788592835.279601:0:15192:0:(genops.c:885:class_export_put()) final put ffff92186f49c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788592835.279605:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788592835.279608:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592835.279617:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788592835.279619:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff921743508000) has no exports 00000020:00000080:1.0:1788592835.279625:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4ca5 00000020:00000080:1.0:1788592835.279629:0:15192:0:(genops.c:885:class_export_put()) final put ffff921876714000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592835.280216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921871437800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788592835.280228:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92186f49c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788592835.280232:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921876714000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788592835.280503:0:15192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788592835.280509:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788592835.280513:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788592835.280518:0:15192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788592835.280521:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788592835.280570:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592835.280583:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788592835.280589:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b6a 00000020:00000080:0.0:1788592835.280605:0:15192:0:(genops.c:885:class_export_put()) final put ffff92186f49e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788592835.280610:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788592835.280614:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592835.280620:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788592835.280623:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff92187d7899c0) has no exports 00000020:00000080:0.0:1788592835.280629:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b63 00000020:00000080:0.0:1788592835.280632:0:15192:0:(genops.c:885:class_export_put()) final put ffff92187d595000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592835.280675:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921876712000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788592835.280684:0:37:0:(genops.c:885:class_export_put()) final put ffff92187c931000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788592835.280687:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c931000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788592835.280694:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592835.280792:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92186f49e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788592835.280801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187d595000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788592835.281006:0:15192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788592835.281009:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788592835.281012:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788592835.281016:0:15192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788592835.281017:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788592835.281057:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592835.281064:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788592835.281117:0:15192:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788592835.281123:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db499c 00000020:00000080:0.0:1788592835.281128:0:15192:0:(genops.c:885:class_export_put()) final put ffff92187c955800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788592835.281132:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788592835.281136:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592835.281140:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788592835.281143:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff921851284d40) has no exports 00000020:00000080:0.0:1788592835.281147:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4995 00000020:00000080:0.0:1788592835.281150:0:15192:0:(genops.c:885:class_export_put()) final put ffff92187c85b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592835.281692:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9218765fc800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788592835.281701:0:37:0:(genops.c:885:class_export_put()) final put ffff921742490800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788592835.281703:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921742490800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788592835.281708:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592835.281769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c955800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788592835.281774:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c85b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788592835.283110:0:15192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788592835.283117:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788592835.283120:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788592835.283126:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788592835.283163:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592835.283174:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788592835.283202:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592835.283214:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788592835.283219:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218696bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788592835.283223:0:15192:0:(genops.c:844:class_export_destroy()) destroying export ffff9218696bd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788592835.283231:0:15192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592835.283249:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92187c85f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788592835.283260:0:37:0:(genops.c:885:class_export_put()) final put ffff92187c859000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788592835.283262:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c859000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788592835.283268:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788592835.283357:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db487d 00000020:00000080:1.0:1788592835.283366:0:15192:0:(genops.c:885:class_export_put()) final put ffff921871433000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788592835.283380:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788592835.283384:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592835.283388:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788592835.283392:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff92186b9fb380) has no exports 00000020:00000080:1.0:1788592835.283421:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592835.283426:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788592835.283430:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921871433000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788592835.283431:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4884 00000020:00000080:1.0:1788592835.283437:0:15192:0:(genops.c:885:class_export_put()) final put ffff921871431800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592835.283439:0:37:0:(genops.c:885:class_export_put()) final put ffff921871430800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788592835.283442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921871430800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788592835.283448:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788592835.283456:0:15192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921846c66000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788592835.283460:0:15192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921846c66000 3 00000020:01000004:1.0:1788592835.283463:0:15192:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff921846c66000 from lustre-MDT0000 00000020:00000080:2.0:1788592835.283490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921871431800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788592835.283500:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592835.283506:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788592835.283509:0:15192:0:(genops.c:885:class_export_put()) final put ffff921871434800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788592835.283512:0:15192:0:(genops.c:844:class_export_destroy()) destroying export ffff921871434800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788592835.283519:0:15192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788592835.283552:0:15192:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788592835.283557:0:15192:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788592835.283560:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788592835.283562:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592835.283565:0:15192:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788592835.283571:0:15192:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff92184ffc1000 ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592835.283576:0:15192:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff921847548000) has exports, disconnecting them 00000020:00080000:1.0:1788592835.283580:0:15192:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92184ffc1000), last request at 1788592621 00000020:00000080:1.0:1788592835.283594:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4822 00000020:00010000:1.0:1788592835.283598:0:15192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92184ffc1000: total 0 00000100:00080000:1.0:1788592835.283601:0:15192:0:(import.c:65:import_set_state_nolock()) ffff92184ffc6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788592835.283621:0:15192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92184ffc1000): rc 0 00000020:00080000:1.0:1788592835.283625:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff921847548000) has no exports 00000020:00010000:2.0:1788592835.283671:0:7920:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92184ffc1000: total 0 00010000:00010000:2.0:1788592835.283698:0:7920:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92184ffc1000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788592835.283728:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80000/0xbd314a3362db4fdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4fd8 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283750:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742838200/0xbd314a3362db4c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4c3c expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283766:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742838000/0xbd314a3362db4fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4fca expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283776:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742838e00/0xbd314a3362db4da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d9a expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283786:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841495000/0xbd314a3362db4d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d2a expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283796:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b81200/0xbd314a3362db4d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d38 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283815:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b81000/0xbd314a3362db4d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d54 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283824:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839200/0xbd314a3362db4d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d46 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283835:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b521a00/0xbd314a3362db492c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4925 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283846:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921742839c00/0xbd314a3362db4fc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4fbc expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283856:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841495800/0xbd314a3362db4d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d62 expref: 4 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283866:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185b521400/0xbd314a3362db491e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4917 expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283875:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841494800/0xbd314a3362db4d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd314a3362db4d70 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.283887:0:7920:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92184ffc1000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788592835.283902:0:7920:0:(genops.c:885:class_export_put()) final put ffff92184ffc1000/ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 00010000:00010000:2.0:1788592835.283919:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592835.283921:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592835.283923:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592835.283973:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92184ffc1000/ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 for MGS 00000020:00000080:1.0:1788592835.284004:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92184ffc6000 for MGS 00000100:00100000:0.0:1788592835.291680:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff921851785200:6507] 2 exiting: rc = 0 00000100:00100000:0.0:1788592835.291900:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff921850ed6800:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1788592835.291961:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff921850ed6400:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1788592835.292194:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292203:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292211:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292217:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292223:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292243:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292252:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292261:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292271:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292278:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292285:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292291:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292296:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292301:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292306:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292312:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292319:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292334:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292341:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292347:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292353:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292358:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292365:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292370:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292376:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292381:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292387:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292392:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292398:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292403:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292408:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292414:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292418:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292423:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292427:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292432:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292437:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292441:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292446:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292451:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292466:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292472:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292476:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292482:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292487:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292492:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292497:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292502:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292507:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292513:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292520:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292527:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292533:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292539:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292546:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292553:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292562:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292570:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292577:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292584:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292591:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292598:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292606:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592835.292614:0:15192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788592835.293519:0:15192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9217436cb660 - data ffff9218592fa360/ffff921743811400 00000020:01000000:1.0:1788592835.293641:0:15192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff921858ded300 - data ffff9218788735e8/ffff9218512a2c00 00000020:00000080:1.0:1788592835.294165:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4806 00000020:00000080:1.0:1788592835.294173:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218696aa800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788592835.294189:0:15192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921846c66000 from MGS, refs=2 00000020:01000004:1.0:1788592835.294192:0:15192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921846c66000 2 00000020:01000004:1.0:1788592835.294195:0:15192:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff921846c66000 from MGS 00000020:00000080:1.0:1788592835.294215:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592835.294222:0:15192:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788592835.294224:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218696ae000/MGS 00000020:00000080:1.0:1788592835.294236:0:15192:0:(genops.c:844:class_export_destroy()) destroying export ffff9218696ae000/MGS for MGS 00000020:01000000:1.0:1788592835.294242:0:15192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788592835.294301:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788592835.294305:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592835.294311:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788592835.294317:0:15192:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9218759f8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592835.294322:0:15192:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff92184754b380) has exports, disconnecting them 00000020:00080000:1.0:1788592835.294336:0:15192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9218759f8000), last request at 1788592621 00000020:00000080:1.0:1788592835.294340:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db48d1 00000020:00080000:1.0:1788592835.294350:0:15192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9218759f8000): rc 0 00000020:00000080:1.0:1788592835.294354:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218759f8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788592835.295186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9218696aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788592835.295198:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9218759f8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788592835.301158:0:15192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788592835.301177:0:15192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788592835.301181:0:15192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788592835.301188:0:15192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788592835.301220:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921848c6d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788592835.301469:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592835.301478:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788592835.301483:0:15192:0:(genops.c:885:class_export_put()) final put ffff921848c6a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788592835.301487:0:15192:0:(genops.c:844:class_export_destroy()) destroying export ffff921848c6a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788592835.301497:0:15192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788592835.301579:0:15192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921846c66000 1 00000020:00000080:2.0:1788592835.301585:0:15192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db47f8 00000020:00000080:2.0:1788592835.301593:0:15192:0:(genops.c:885:class_export_put()) final put ffff9218696a9000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788592835.301602:0:15192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788592835.301612:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9218696a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788592835.301623:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788592835.301628:0:15192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788592835.301710:0:15192:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff921851280000) has no exports 00000020:00000080:2.0:1788592835.365267:0:15192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592835.365280:0:15192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788592835.365286:0:15192:0:(genops.c:885:class_export_put()) final put ffff92184af38000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592835.365290:0:15192:0:(genops.c:844:class_export_destroy()) destroying export ffff92184af38000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788592835.365295:0:15192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788592835.365421:0:15192:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff921846c62800 00000020:02000400:2.0:1788592835.365485:0:15192:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788592835.384561:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226054144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592835.384929:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592835.384987:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054144 00000100:00100000:0.0:1788592835.384995:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054144 00000100:00100000:0.0:1788592835.385042:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788592835.385059:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921844d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226054144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592835.385109:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788592835.385230:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921844d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226054144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592835.385237:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788592835.385284:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226054144:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788592835.517626:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592836.551469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592837.560405:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592838.136801:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788592838.534461:0:15394:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788592838.557410:0:15394:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788592838.557465:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.557481:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.557489:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.557495:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.557514:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788592838.557520:0:15394:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788592838.557544:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592838.557548:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788592838.557553:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788592838.557558:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9218765fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788592838.557563:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592838.557578:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788592838.557581:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788592838.558395:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558407:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558413:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558419:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558441:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788592838.558446:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558453:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558458:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558464:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558477:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788592838.558483:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558503:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558509:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558515:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558523:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788592838.558529:0:15394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558535:0:15394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558541:0:15394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558547:0:15394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592838.558555:0:15394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1788592838.558558:0:15394:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788592838.558580:0:15394:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788592838.558584:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788592838.558588:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592838.558593:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788592838.558599:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff92187d597000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788592838.558611:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff921742494000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788592838.558616:0:15394:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff921850ee3380) has exports, disconnecting them 00000020:00080000:0.0:1788592838.558620:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff92187d597000), last request at 1788592834 00000020:00000080:0.0:1788592838.558628:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4c04 00000100:00080000:0.0:1788592838.558649:0:15394:0:(import.c:65:import_set_state_nolock()) ffff92186f49c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788592838.558696:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92187d597000): rc 0 00000020:00000080:0.0:1788592838.558698:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187d597000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788592838.558709:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff921742494000), last request at 1788592834 00000020:00000080:0.0:1788592838.558712:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4ade 00000100:00080000:0.0:1788592838.558717:0:15394:0:(import.c:65:import_set_state_nolock()) ffff921742493800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788592838.558728:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187d597000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788592838.558768:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92186f49c000 for lustre-MDT0001 00000020:00080000:0.0:1788592838.558781:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff921742494000): rc 0 00000020:00000080:0.0:1788592838.558783:0:15394:0:(genops.c:885:class_export_put()) final put ffff921742494000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788592838.558793:0:15394:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb76c81697ae0 00000020:00000080:0.0:1788592838.558804:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921742494000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788592838.558823:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921742493800 for lustre-MDT0001 00000100:00080000:0.0:1788592838.558841:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592838.558844:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788592838.559610:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788592838.559616:0:15394:0:(import.c:65:import_set_state_nolock()) ffff9218696bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1788592838.559720:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788592838.559729:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559738:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592838.559742:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559751:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592838.559759:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592838.559765:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592838.559768:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788592838.559770:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788592838.559809:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559817:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592838.559846:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559854:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742838600/0xbd314a3362db4d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559879:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788592838.559883:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559888:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e800 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592838.559891:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559898:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592838.559905:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592838.559911:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592838.559913:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788592838.559915:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788592838.559930:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559936:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592838.559943:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559950:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db4d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559958:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788592838.559961:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559973:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80c00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592838.559976:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.559983:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592838.559989:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592838.559994:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592838.559996:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788592838.559998:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788592838.560013:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560020:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592838.560036:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560043:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b80c00/0xbd314a3362db4c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4c43 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560055:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592838.560058:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560083:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81800 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592838.560087:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560101:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592838.560107:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592838.560112:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788592838.560113:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788592838.560116:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788592838.560128:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560133:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592838.560138:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560144:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b81800/0xbd314a3362db4fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db4fdf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560153:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592838.560156:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560161:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185b520e00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592838.560164:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560171:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592838.560187:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592838.560193:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592838.560195:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788592838.560197:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788592838.560218:0:7920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560224:0:7920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592838.560229:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560235:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b520e00/0xbd314a3362db4925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd314a3362db492c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592838.560246:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592838.560247:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592838.560249:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592838.560272:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226054400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592838.560348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.560404:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788592838.560410:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226054272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592838.560433:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.560449:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226054784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592838.560469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.560494:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226054528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592838.560526:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.560545:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592838.560550:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226054656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592838.560568:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.560592:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054400 00000100:00100000:3.0:1788592838.560598:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054400 00000100:00100000:3.0:1788592838.560625:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054272 00000100:00100000:3.0:1788592838.560628:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054272 00000100:00100000:3.0:1788592838.560636:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054784 00000100:00100000:3.0:1788592838.560638:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054784 00000100:00100000:3.0:1788592838.560644:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054528 00000100:00100000:3.0:1788592838.560646:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054528 00000100:00100000:3.0:1788592838.560652:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054656 00000100:00100000:3.0:1788592838.560654:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054656 00000100:00100000:3.0:1788592838.560665:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592838.560671:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1875475226054400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788592838.560677:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592838 with bad export cookie 13632759131589527586 00010000:00010000:1.0:1788592838.563408:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592838.563542:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592838.563553:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1875475226054272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788592838.563561:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592838 with bad export cookie 13632759131589527586 00000100:00100000:1.0:1788592838.563650:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1875475226054272:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (3214us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788592838.563658:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592838.563684:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592838.563689:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1875475226054784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788592838.563693:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592838 with bad export cookie 13632759131589527586 00000100:00100000:1.0:1788592838.563719:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1875475226054784:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (3248us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788592838.563724:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592838.563738:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592838.563742:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1875475226054528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788592838.563746:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592838 with bad export cookie 13632759131589527586 00000100:00100000:1.0:1788592838.563800:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1875475226054528:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (3272us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788592838.563807:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592838.563820:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592838.563825:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1875475226054656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788592838.563829:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592838 with bad export cookie 13632759131589527586 00000100:00100000:1.0:1788592838.563855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1875475226054656:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (3286us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788592838.563861:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788592838.563920:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.147@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788592838.563925:0:3642:0:(import.c:65:import_set_state_nolock()) ffff92184532d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788592838.563929:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788592838.564026:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788592838.564084:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.147@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788592838.564227:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788592838.564232:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788592838.564244:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788592838.564323:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788592838.564345:0:15394:0:(import.c:65:import_set_state_nolock()) ffff921876711000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788592838.564361:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788592838.564371:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788592838.564380:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788592838.564437:0:15394:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788592838.564450:0:15394:0:(import.c:65:import_set_state_nolock()) ffff92187c935000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788592838.564473:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff921850ee3380) has no exports 00000100:00100000:3.0:1788592838.568279:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226054912:0@lo:9:umount.0 00000100:00100000:3.0:1788592838.571026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.571093:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226055040:0@lo:9:umount.0 00000100:00100000:3.0:1788592838.571122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592838.571378:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226054912 00000100:00100000:3.0:1788592838.571385:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226054912 00000100:00100000:3.0:1788592838.571439:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226055040 00000100:00100000:3.0:1788592838.571441:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226055040 00000100:00100000:3.0:1788592838.571463:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788592838.571471:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1875475226054912:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788592838.571498:0:10091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b2b 00000100:00080000:3.0:1788592838.571522:0:10091:0:(import.c:65:import_set_state_nolock()) ffff921876717000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592838.571565:0:10091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788592838.571711:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3638:x1875475226054912:12345-0@lo:9:umount.0 Request processed in 240us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592838.571720:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788592838.571736:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788592838.571743:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1875475226055040:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788592838.571754:0:10091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4c6d 00000100:00080000:3.0:1788592838.571759:0:10091:0:(import.c:65:import_set_state_nolock()) ffff9217434f7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592838.571781:0:10091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788592838.571853:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3638:x1875475226055040:12345-0@lo:9:umount.0 Request processed in 111us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592838.571860:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788592838.572394:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592838.572398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788592838.572411:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592838.572443:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921876711000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788592838.572455:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788592838.572457:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788592838.572461:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921844d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226054912:0@lo:9:umount.0 00000100:00080000:3.0:1788592838.572472:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c935000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788592838.572479:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788592838.572480:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788592838.572482:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226055040:0@lo:9:umount.0 00010000:00010000:3.0:1788592838.572511:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592838.572547:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1875475226054400:12345-0@lo:103:ldlm_bl.0 Request processed in 11875us (12200us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788592838.572555:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788592838.589549:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.147@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788592838.589555:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788592838.589564:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360df80 x1875475226054400/t0(0) o103->MGC192.168.203.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592854 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592838.589579:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360e680 x1875475226054272/t0(0) o103->MGC192.168.203.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592854 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592838.589588:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360f800 x1875475226054784/t0(0) o103->MGC192.168.203.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592854 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592838.589595:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360f100 x1875475226054528/t0(0) o103->MGC192.168.203.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592854 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592838.589604:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360e300 x1875475226054656/t0(0) o103->MGC192.168.203.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592854 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788592838.589620:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788592838.589623:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788592838.589624:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788592838.589692:0:3639:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff92184532d000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1788592838.589693:0:3642:0:(import.c:65:import_set_state_nolock()) ffff92184532d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592838.589699:0:3642:0:(import.c:545:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 155 00000100:00080000:1.0:1788592838.589708:0:3642:0:(import.c:665:import_select_connection()) MGC192.168.203.147@tcp: import ffff92184532d000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592838.589760:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226054528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592838.589784:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592838.589789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3639:1875475226054656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592838.590272:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744779180 x1875475226055168/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592838.590299:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226054784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592838.590317:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226054400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592838.590336:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3642:1875475226054272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592838.590387:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3638:1875475226055168:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788592838.590432:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875475226055168 offset 0 length 520: 4 00000020:00080000:1.0:1788592838.596999:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff921850ee3380) has no exports 00000020:01000000:3.0:1788592838.658600:0:15394:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff921875a816c0 - data ffff9218592f9438/ffff921742a7e000 00000020:01000000:3.0:1788592838.658755:0:15394:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9218764e5ba0 - data ffff921878920870/ffff921876646c00 00000001:00000004:3.0:1788592838.666814:0:15394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788592838.725060:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788592838.725089:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788592838.725097:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788592838.727010:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788592838.727017:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788592838.727037:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788592838.727039:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788592838.727894:0:8581:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788592838.727899:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788592838.727911:0:8581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788592838.728664:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788592838.728668:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788592838.728687:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788592838.728689:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788592838.730660:0:10025:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788592838.730668:0:10025:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788592838.730686:0:10025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788592838.733752:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4948 00000020:00000080:1.0:1788592838.733765:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c937000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788592838.734314:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c937000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788592838.740664:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db495d 00000020:00000080:1.0:1788592838.740684:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c956000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788592838.740735:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788592838.740741:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592838.740748:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788592838.740752:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff921850ee0000) has no exports 00000004:01000000:1.0:1788592838.740931:0:15394:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788592838.740940:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4c66 00000020:00000080:1.0:1788592838.740945:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c934800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592838.741719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c956000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788592838.741806:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788592838.741811:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592838.741821:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788592838.741824:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff921742aa0000) has no exports 00000020:00000080:1.0:1788592838.741830:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4c5f 00000020:00000080:1.0:1788592838.741835:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c931800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788592838.741984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c934800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788592838.741992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c931800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788592838.742641:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788592838.742645:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788592838.742650:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788592838.742665:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788592838.742668:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788592838.742750:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592838.742760:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788592838.742766:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b24 00000020:00000080:1.0:1788592838.742772:0:15394:0:(genops.c:885:class_export_put()) final put ffff921876713000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592838.743195:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92187c935000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788592838.743205:0:8:0:(genops.c:885:class_export_put()) final put ffff921876715800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592838.743208:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff921876715800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788592838.743214:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788592838.743580:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788592838.743585:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592838.743593:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788592838.743596:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff92187d750000) has no exports 00000020:00000080:1.0:1788592838.743603:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b1d 00000020:00000080:1.0:1788592838.743607:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c957800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788592838.744142:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788592838.744146:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788592838.744149:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788592838.744154:0:15394:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788592838.744156:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788592838.744182:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592838.744189:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788592838.744201:0:15394:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788592838.744207:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db49b1 00000020:00000080:1.0:1788592838.744212:0:15394:0:(genops.c:885:class_export_put()) final put ffff9218696b9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788592838.744216:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788592838.744220:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592838.744223:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788592838.744226:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff92187d78cd40) has no exports 00000020:00000080:1.0:1788592838.744230:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db49aa 00000020:00000080:1.0:1788592838.744233:0:15394:0:(genops.c:885:class_export_put()) final put ffff9218696bb800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788592838.745247:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff921876713000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788592838.745264:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c957800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788592838.745271:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921876711000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788592838.745277:0:8:0:(genops.c:885:class_export_put()) final put ffff92187c932000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592838.745280:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c932000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788592838.745284:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788592838.745535:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9218696b9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788592838.745552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9218696bb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788592838.748129:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788592838.748137:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592838.748141:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788592838.748149:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788592838.748194:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592838.748205:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788592838.748228:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592838.748230:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788592838.748236:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c933800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788592838.748240:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c933800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788592838.748251:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788592838.748417:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4964 00000020:00000080:0.0:1788592838.748424:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c950800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788592838.748428:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788592838.748441:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592838.748446:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788592838.748450:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff921850ee19c0) has no exports 00000020:00000080:0.0:1788592838.748467:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592838.748470:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788592838.748475:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db496b 00000020:00000080:0.0:1788592838.748479:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c955000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788592838.748487:0:15394:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921875948800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788592838.748490:0:15394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921875948800 2 00000020:01000004:0.0:1788592838.748493:0:15394:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff921875948800 from lustre-MDT0001 00000020:00000080:0.0:1788592838.748511:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592838.748515:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788592838.748518:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187c932800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788592838.748520:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c932800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788592838.748527:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788592838.748555:0:15394:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788592838.748558:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788592838.748561:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592838.748564:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788592838.748570:0:15394:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9218765f9000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788592838.748574:0:15394:0:(genops.c:1553:class_disconnect_exports()) OBD device 15 (ffff92187d753380) has exports, disconnecting them 00000020:00080000:0.0:1788592838.748579:0:15394:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9218765f9000), last request at 1788592637 00000020:00000080:0.0:1788592838.748582:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db49fe 00000020:00080000:0.0:1788592838.748592:0:15394:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9218765f9000): rc 0 00000020:00000080:0.0:1788592838.748595:0:15394:0:(genops.c:885:class_export_put()) final put ffff9218765f9000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788592838.749532:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9218696bc000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788592838.749543:0:8:0:(genops.c:885:class_export_put()) final put ffff92185165f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592838.749545:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92185165f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788592838.749551:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788592838.749669:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c950800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788592838.749673:0:8:0:(genops.c:885:class_export_put()) final put ffff92187c933000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788592838.749676:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c933000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788592838.749680:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788592838.749861:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c955000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788592838.749867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9218765f9000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788592838.749909:0:15394:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788592838.749914:0:15394:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788592838.749917:0:15394:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788592838.749922:0:15394:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788592838.749940:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9218765fd800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788592838.750094:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592838.750101:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788592838.750104:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187d596000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788592838.750107:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff92187d596000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788592838.750111:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788592838.750144:0:15394:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921875948800 1 00000020:00000080:3.0:1788592838.750149:0:15394:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db48fb 00000020:00000080:3.0:1788592838.750153:0:15394:0:(genops.c:885:class_export_put()) final put ffff921875a9f000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788592838.750161:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788592838.750168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff921875a9f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788592838.750176:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592838.750180:0:15394:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788592838.750191:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9218512819c0) has no exports 00000020:00000080:3.0:1788592838.792028:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592838.792049:0:15394:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788592838.792055:0:15394:0:(genops.c:885:class_export_put()) final put ffff92187594e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788592838.792059:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff92187594e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788592838.792083:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788592838.792198:0:15394:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92187594a800 00000020:01000000:3.0:1788592838.792218:0:15394:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788592838.792222:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592838.792226:0:15394:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788592838.792230:0:15394:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff92186b9f99c0) has no exports 00000100:00100000:0.0:1788592838.792339:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff92184575ec00:6514] 2 exiting: rc = 0 00000100:00100000:1.0:1788592838.792423:0:10029:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9217434e5000:10029] 3 exiting: rc = 0 00000100:00100000:0.0:1788592838.792474:0:13208:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff921847591a00:13208] 4 exiting: rc = 0 00000100:00100000:1.0:1788592838.792560:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92184575f600:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1788592838.792809:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff921850ed7c00:6512] 0 exiting: rc = 1 00000100:00100000:3.0:1788592838.796162:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796173:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796179:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796184:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796190:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796196:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796201:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796206:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796212:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796217:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796222:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796226:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796231:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796236:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796241:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796247:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796251:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796256:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796261:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796266:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796272:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796278:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796282:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796310:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796316:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796321:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796327:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796332:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796337:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796341:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796346:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796358:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796363:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796369:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796374:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796380:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796385:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796390:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796396:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796401:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796405:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796410:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796415:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796420:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796425:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796430:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796435:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796441:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796446:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796451:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796457:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796462:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796468:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796474:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796479:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796490:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796497:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796501:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796511:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796516:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796521:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796526:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796531:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.796537:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.799151:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff92184575e000:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1788592838.799419:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92184575e600:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1788592838.799507:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799514:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799615:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799622:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799627:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799633:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799638:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799643:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799648:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799654:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799659:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799666:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799672:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799677:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799681:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799686:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799690:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799695:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799700:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799705:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799709:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799713:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799718:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799722:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799727:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799731:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799736:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799740:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799745:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799762:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799767:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799772:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799777:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799782:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799787:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799792:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799797:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799802:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799807:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799811:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799816:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799821:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799826:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799832:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799837:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799842:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799847:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799851:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799856:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799861:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799865:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799869:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799874:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799880:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799890:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799940:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799946:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799951:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799956:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799961:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799966:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799970:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799975:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.799980:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.800823:0:7782:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff92187d784000:7782] 2 exiting: rc = 0 00000100:00100000:0.0:1788592838.800973:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92186baa9a00:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1788592838.801033:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92184575ea00:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1788592838.801397:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801405:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801410:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801416:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801421:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801427:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801432:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801448:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801455:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801461:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801468:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801474:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801479:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801485:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801491:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801496:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801502:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801506:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801511:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801614:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801620:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801625:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801630:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801635:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801641:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801646:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801651:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801657:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801662:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801667:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801672:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801689:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801695:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801700:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801704:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801716:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801721:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801727:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801732:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801737:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801742:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801748:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801754:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801773:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801780:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801784:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801791:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801796:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801802:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801808:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801814:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801819:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801825:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801830:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801836:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801856:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801863:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801919:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801927:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801933:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801938:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801945:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801951:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.801965:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.817790:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff92184575e800:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1788592838.818274:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92184575f000:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1788592838.818675:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818682:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818686:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818691:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818695:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818700:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818704:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818709:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818713:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818718:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818722:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818726:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818731:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818736:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818740:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818744:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818749:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818754:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818759:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818763:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818768:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818772:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818777:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818782:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818787:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818792:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818797:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818803:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818807:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818812:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818816:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818820:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818825:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818830:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818843:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818848:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818853:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818858:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818862:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818867:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818872:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818877:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818886:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818894:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818899:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818905:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.818910:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819003:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819010:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819015:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819019:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819024:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819029:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819033:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819038:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819042:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819047:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819051:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819056:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819060:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819124:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819131:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819136:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.819141:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592838.820757:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff921846647600:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1788592838.820912:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff921878de3600:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1788592838.821001:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821007:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821012:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821017:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821021:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821035:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821039:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821043:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821048:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821052:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821058:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821063:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821091:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821096:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821101:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821106:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821110:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821115:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821119:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821123:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821128:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821131:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821135:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821139:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821144:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821148:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821152:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821157:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821161:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821165:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821169:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821174:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821178:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821183:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821187:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821191:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821196:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821200:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821204:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821209:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821221:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821226:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821231:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821236:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821240:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821245:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821250:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821256:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821260:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821329:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821335:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821340:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821345:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821351:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821355:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821361:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821366:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821371:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821376:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821425:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821460:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821465:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821470:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.821475:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.821994:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff921878de3e00:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1788592838.822131:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff921878de3c00:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1788592838.822217:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822222:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822227:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822232:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822236:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822240:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822245:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822249:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822254:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822259:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822263:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822624:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822629:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822634:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822639:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822643:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822647:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822651:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822656:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822983:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822992:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.822997:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823002:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823007:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823012:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823016:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823020:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823025:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823029:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823033:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823037:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823041:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823046:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823050:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823055:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823059:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823063:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823395:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823400:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823405:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823409:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823414:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823418:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823423:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823427:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823431:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823443:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823448:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823452:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823457:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823461:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823466:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823470:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823475:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823479:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823483:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823488:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823492:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823497:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823502:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823506:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823510:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823515:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.823872:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592838.825356:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff921844d44200:6527] 2 exiting: rc = 0 00000100:00100000:2.0:1788592838.825735:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff921860683800:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1788592838.826004:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff921860682a00:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1788592838.826346:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826356:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826363:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826369:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826374:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826380:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826386:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826391:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826396:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826401:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826427:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826457:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826463:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826468:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826473:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826480:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826486:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826504:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.826510:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827219:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827231:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827237:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827244:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827250:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827255:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827261:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827371:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827380:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827385:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827391:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827397:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827402:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827406:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827411:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827449:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827456:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827462:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827468:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827473:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827478:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827483:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827814:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827824:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827829:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827835:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827840:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827845:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827851:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827856:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827863:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827869:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827874:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827889:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827895:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827901:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827908:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827914:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827921:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827927:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827933:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827938:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827944:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827950:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592838.827956:0:15394:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788592838.835892:0:15394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592838.835904:0:15394:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788592838.835910:0:15394:0:(genops.c:885:class_export_put()) final put ffff921851659800/MDS_uuid 00000020:00000080:0.0:1788592838.835915:0:15394:0:(genops.c:844:class_export_destroy()) destroying export ffff921851659800/MDS_uuid for MDS 00000020:01000000:0.0:1788592838.835928:0:15394:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788592838.836231:0:15394:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:2.0:1788592839.484226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788592839.484235:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592839.484238:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788592839.484242:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788592839.484246:0:37:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592839.484254:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 368 00000100:00080000:2.0:1788592839.484260:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788592839.484268:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92187d590800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592839.484315:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d50aa00 x1875475226055296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592839.484374:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788592839.484377:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788592839.484379:0:37:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592839.484383:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 368 00000100:00080000:2.0:1788592839.484385:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788592839.484389:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff921742497800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592839.484400:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d508e00 x1875475226055552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592839.484438:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226055424:0@lo:400:kworker.0 00000400:00000100:2.0:1788592839.484488:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226055424 offset 0 length 224: 4 00000100:00100000:3.0:1788592839.488347:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226055296:0@lo:38:kworker.0 00000400:00000100:3.0:1788592839.488409:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226055296 offset 0 length 520: 4 00000100:00100000:3.0:1788592839.488446:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226055552:0@lo:38:kworker.0 00000400:00000100:3.0:1788592839.488463:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226055552 offset 0 length 520: 4 00000100:00100000:0.0:1788592839.488467:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226055680:0@lo:400:kworker.0 00000400:00000100:0.0:1788592839.488489:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226055680 offset 0 length 224: 4 00010000:00010000:3.0:1788592839.608228:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592840.633370:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592841.657163:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788592842.138767:0:15594:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788592842.156203:0:15594:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788592842.156254:0:15594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.156269:0:15594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.156285:0:15594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.156293:0:15594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.156315:0:15594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592842.156349:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592842.156358:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.156367:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81e00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:3.0:1788592842.156371:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592842.156379:0:15594:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788592842.156384:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592842.156393:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592842.156400:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592842.156402:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:0.0:1788592842.156405:0:15594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:3.0:1788592842.156406:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788592842.156419:0:15594:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d50aa00 x1875475226055296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788592842.156423:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:3.0:1788592842.156430:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.156445:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b81e00/0xbd314a3362db4d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.156457:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592842.156459:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592842.156474:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592842.156488:0:15594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788592842.156502:0:15594:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788592842.156507:0:15594:0:(import.c:65:import_set_state_nolock()) ffff92187d590800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788592842.156511:0:15594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592842.156515:0:15594:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d50aa00 x1875475226055296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592859 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592842.157000:0:15594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788592842.157024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226055296:0@lo:38:kworker.0 00000100:00100000:0.0:1788592842.157183:0:15594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788592842.158890:0:15594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788592842.158903:0:15594:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d509c00 x1875475226055424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592842.159084:0:15594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788592842.159089:0:15594:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788592842.159115:0:15594:0:(import.c:65:import_set_state_nolock()) ffff921742495000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788592842.159243:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226055424:0@lo:400:kworker.0 00000100:00100000:1.0:1788592842.159247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1875475226055808:0@lo:39:umount.0 00000400:00000100:1.0:1788592842.159309:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226055808 offset 0 length 224: 4 00010000:00010000:3.0:1788592842.683877:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592843.513689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592843.513700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592843.513704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592843.513708:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788592843.513862:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592843.513894:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226055936:0@lo:400:kworker.0 00000400:00000100:1.0:1788592843.513951:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226055936 offset 0 length 224: 4 00010000:00010000:2.0:1788592843.704216:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592844.541862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592844.541872:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592844.541876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592844.541879:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788592844.542038:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226056064:0@lo:400:kworker.0 00000400:00000100:1.0:1788592844.542125:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226056064 offset 0 length 224: 4 00000001:00100000:0.0:1788592844.602570:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788592844.602577:0:9505:0:(genops.c:885:class_export_put()) final put ffff9217434f1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788592844.602694:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9217434f1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788592844.602740:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9217434f7000 for lustre-OST0001 00000001:00100000:2.0:1788592844.604185:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788592844.604191:0:8422:0:(genops.c:885:class_export_put()) final put ffff921876711800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788592844.604381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff921876711800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788592844.604507:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921876717000 for lustre-OST0000 00010000:00010000:3.0:1788592844.728286:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592845.752341:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592846.776202:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592847.800293:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592848.313195:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592838/real 1788592838] req@ffff921744779180 x1875475226055168/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788592848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592848.313244:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff921744779180 x1875475226055168/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788592848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592848.313267:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92184532d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592848.313296:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788592848.313302:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3638:1875475226055168:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788592848.313958:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788592848.313966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788592848.313969:0:8:0:(import.c:65:import_set_state_nolock()) ffff92184532d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592848.313975:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 372 00000100:00080000:0.0:1788592848.313980:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.147@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788592848.313987:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.147@tcp: import ffff92184532d000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592848.314020:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744778e00 x1875475226056192/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788592848.314045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788592848.314050:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592848.314186:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226056320:0@lo:400:kworker.0 00000400:00000100:2.0:1788592848.314247:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226056320 offset 0 length 224: 4 00000100:00100000:1.0:1788592848.315117:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3638:1875475226056192:0@lo:250:kworker.0 00000400:00000100:1.0:1788592848.315410:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875475226056192 offset 0 length 520: 4 00010000:00010000:3.0:1788592848.824524:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592849.848946:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592850.872415:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.896353:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592852.408234:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592842/real 1788592842] req@ffff921744778380 x1875475226055808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788592852 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592852.408278:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff921744778380 x1875475226055808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788592852 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592852.408299:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921742495000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788592852.408320:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1875475226055808:0@lo:39:umount.0 00000100:00080000:0.0:1788592852.408519:0:15594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788592852.408539:0:15594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788592852.408544:0:15594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788592852.412234:0:15594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412255:0:15594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412263:0:15594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412271:0:15594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412545:0:15594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592852.412555:0:15594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412563:0:15594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412569:0:15594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592852.412575:0:15594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412645:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592852.412652:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412659:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592852.412662:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412671:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592852.412677:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592852.412683:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788592852.412685:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788592852.412697:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:2.0:1788592852.412710:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412738:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db4d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412759:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592852.412763:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412768:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592852.412771:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412777:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592852.412783:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592852.412787:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788592852.412789:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788592852.412794:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:2.0:1788592852.412797:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592852.412804:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592852.412806:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592852.412808:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592852.413206:0:15594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788592852.413220:0:15594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921742838400/0xbd314a3362db4fca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4fd1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592852.413244:0:15594:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788592852.413251:0:15594:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788592852.413262:0:15594:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788592852.413299:0:15594:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788592852.413304:0:15594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788592852.413308:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592852.413314:0:15594:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788592852.413318:0:15594:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff92187d7519c0) has no exports 00000020:00080000:0.0:1788592852.413349:0:15594:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff92187d7519c0) has no exports 00010000:00010000:3.0:1788592852.416855:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788592852.417025:0:15594:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff921875a81c60 - data ffff9218592f96c0/ffff92174379b400 00000020:01000000:0.0:1788592852.417292:0:15594:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9217424c7480 - data ffff921878a3d288/ffff921876729c00 00100000:10000000:0.0:1788592852.432173:0:15594:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788592852.442016:0:15594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4a98 00000020:00000080:1.0:1788592852.442027:0:15594:0:(genops.c:885:class_export_put()) final put ffff92187c936800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788592852.442045:0:15594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9218764b9000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788592852.442048:0:15594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9218764b9000 2 00000020:01000004:1.0:1788592852.442051:0:15594:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9218764b9000 from lustre-OST0000 00000020:00000080:1.0:1788592852.442101:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592852.442110:0:15594:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788592852.442113:0:15594:0:(genops.c:885:class_export_put()) final put ffff92187c934000/lustre-OST0000_UUID 00000020:00000080:1.0:1788592852.442116:0:15594:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c934000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788592852.442122:0:15594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788592852.442189:0:15594:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788592852.442193:0:15594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788592852.442196:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592852.442201:0:15594:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788592852.442216:0:15594:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92187c930000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592852.442222:0:15594:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff92187d754d40) has exports, disconnecting them 00000020:00080000:1.0:1788592852.442227:0:15594:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92187c930000), last request at 1788592654 00000020:00000080:1.0:1788592852.442232:0:15594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4ac2 00000020:00080000:1.0:1788592852.442249:0:15594:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92187c930000): rc 0 00000020:00000080:1.0:1788592852.442254:0:15594:0:(genops.c:885:class_export_put()) final put ffff92187c930000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788592852.442912:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c936800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788592852.442928:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c930000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788592852.504409:0:15594:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788592852.504418:0:15594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592852.504422:0:15594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788592852.504429:0:15594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788592852.504605:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592852.504615:0:15594:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788592852.504622:0:15594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788592852.504629:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592852.504633:0:15594:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788592852.504641:0:15594:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff921742492800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592852.504647:0:15594:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff92187d78b380) has exports, disconnecting them 00000020:00080000:1.0:1788592852.504651:0:15594:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff921742492800), last request at 1788592654 00000020:00000080:1.0:1788592852.504655:0:15594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4ad7 00000020:00080000:1.0:1788592852.504672:0:15594:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff921742492800): rc 0 00000020:00000080:1.0:1788592852.504677:0:15594:0:(genops.c:885:class_export_put()) final put ffff921742492800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788592852.505003:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92187d590800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788592852.505021:0:37:0:(genops.c:885:class_export_put()) final put ffff92187c930800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788592852.505024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92187c930800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788592852.505037:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788592852.505118:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921742492800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788592852.511139:0:15594:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788592852.511148:0:15594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788592852.511153:0:15594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788592852.511160:0:15594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788592852.511238:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921742495000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788592852.511467:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592852.511477:0:15594:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788592852.511482:0:15594:0:(genops.c:885:class_export_put()) final put ffff921742492000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788592852.511485:0:15594:0:(genops.c:844:class_export_destroy()) destroying export ffff921742492000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788592852.511491:0:15594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788592852.511550:0:15594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9218764b9000 1 00000020:00000080:2.0:1788592852.511556:0:15594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4a60 00000020:00000080:2.0:1788592852.511562:0:15594:0:(genops.c:885:class_export_put()) final put ffff921875a9a000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788592852.511571:0:15594:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788592852.511575:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788592852.511579:0:15594:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788592852.511583:0:15594:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff92187d788000) has no exports 00000020:00000080:3.0:1788592852.513102:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921875a9a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788592852.553458:0:15594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592852.553473:0:15594:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788592852.553479:0:15594:0:(genops.c:885:class_export_put()) final put ffff9218764be000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788592852.553483:0:15594:0:(genops.c:844:class_export_destroy()) destroying export ffff9218764be000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788592852.553496:0:15594:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788592852.553785:0:15594:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9218764ba000 00000020:02000400:3.0:1788592852.553842:0:15594:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788592852.920236:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788592853.816305:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788592853.816315:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788592853.816318:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788592853.816321:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788592853.816508:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226056448:0@lo:400:kworker.0 00000400:00000100:3.0:1788592853.816558:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226056448 offset 0 length 224: 4 00010000:00010000:2.0:1788592853.944792:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592854.968252:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788592855.865148:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592839/real 1788592839] req@ffff92186d50b480 x1875475226055680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788592855 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592855.890990:0:3639:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff92186d50b480 x1875475226055680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788592855 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592855.891005:0:3639:0:(import.c:65:import_set_state_nolock()) ffff92186ba51000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788592855.891009:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788592855.899969:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788592855.900016:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226055680:0@lo:400:kworker.0 00000100:00080000:2.0:1788592855.900058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788592855.900063:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592855.900083:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788592855.900087:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592855.900089:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788592855.900092:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788592855.900096:0:37:0:(import.c:65:import_set_state_nolock()) ffff92186ba51000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592855.900102:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 206 00000100:00080000:2.0:1788592855.900110:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff92186ba51000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592855.900144:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d509c00 x1875475226056576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592855.900389:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1875475226056576:0@lo:38:kworker.0 00000400:00000100:1.0:1788592855.900450:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475226056576 offset 0 length 520: 4 00000020:01000004:0.0:1788592855.932019:0:15796:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788592855.944016:0:15796:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788592855.944129:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.944144:0:15796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.944152:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.944159:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.944178:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788592855.944192:0:15796:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788592855.944216:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788592855.944228:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d508e00 x1875475226055552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592855.944245:0:15796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788592855.944250:0:15796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788592855.944257:0:15796:0:(import.c:65:import_set_state_nolock()) ffff921742497800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788592855.944338:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788592855.944342:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d508e00 x1875475226055552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592859 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592855.944349:0:15796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788592855.944353:0:15796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:0.0:1788592855.944409:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592855.944416:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592855.944424:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592855.944435:0:7920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592855.944444:0:7920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592855.944451:0:7920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592855.944457:0:7920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788592855.944461:0:7920:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788592855.944463:0:7920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788592855.944476:0:7920:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:0.0:1788592855.944480:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592855.944488:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b81400/0xbd314a3362db4d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d31 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592855.944499:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592855.944500:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592855.944502:0:7920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592855.947163:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226055552:0@lo:38:kworker.0 00000100:00080000:3.0:1788592855.948881:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788592855.948897:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360ca80 x1875475226055936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.948926:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360e300 x1875475226056064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.948941:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174477ad80 x1875475226056320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592864 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.948952:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff921744778a80 x1875475226056448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592869 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.948961:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d509c00 x1875475226056576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.948972:0:15796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788592855.949001:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226056064:0@lo:400:kworker.0 00000100:00080000:3.0:1788592855.949032:0:15796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788592855.949037:0:15796:0:(import.c:65:import_set_state_nolock()) ffff92186ba51000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788592855.949042:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788592855.949046:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174360ca80 x1875475226055936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592859 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.949053:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92174477ad80 x1875475226056320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592864 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.949060:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff921744778a80 x1875475226056448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592869 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.949113:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff92186d509c00 x1875475226056576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592865 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592855.949119:0:15796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788592855.949123:0:15796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1788592855.949199:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226056320:0@lo:400:kworker.0 00000100:00100000:2.0:1788592855.949235:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1875475226056576:0@lo:38:kworker.0 00000100:00100000:2.0:1788592855.949256:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226056448:0@lo:400:kworker.0 00000100:00100000:2.0:1788592855.949271:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226055936:0@lo:400:kworker.0 00010000:00010000:3.0:1788592855.950576:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950592:0:15796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950600:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950607:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950701:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592855.950711:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950718:0:15796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950724:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950730:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592855.950771:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788592855.950776:0:15796:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788592855.950800:0:15796:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788592855.950804:0:15796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788592855.950808:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592855.950813:0:15796:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788592855.950818:0:15796:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff921742aa4d40) has no exports 00000020:00080000:3.0:1788592855.950839:0:15796:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff921742aa4d40) has no exports 00010000:00010000:2.0:1788592855.951231:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592855.951238:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951246:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592855.951249:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951257:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592855.951272:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592855.951277:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788592855.951279:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788592855.951281:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788592855.951294:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:2.0:1788592855.951298:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951304:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db4d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4d3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951330:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592855.951334:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951339:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592855.951342:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951348:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592855.951354:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592855.951359:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788592855.951361:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788592855.951363:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788592855.951370:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:2.0:1788592855.951373:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951379:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921875b81600/0xbd314a3362db4fbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4fc3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592855.951390:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592855.951392:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592855.951394:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592855.952768:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788592855.953592:0:15796:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff921875a81de0 - data ffff92187898fa20/ffff9218767ae000 00000020:01000000:3.0:1788592855.953845:0:15796:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff921741f1a420 - data ffff921878b2f870/ffff92174379a800 00100000:10000000:0.0:1788592855.972172:0:15796:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788592855.978649:0:15796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4bbe 00000020:00000080:1.0:1788592855.978661:0:15796:0:(genops.c:885:class_export_put()) final put ffff921876716800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788592855.978683:0:15796:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92174243f000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788592855.978687:0:15796:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92174243f000 2 00000020:01000004:1.0:1788592855.978691:0:15796:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92174243f000 from lustre-OST0001 00000020:00000080:1.0:1788592855.978720:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592855.978729:0:15796:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788592855.978732:0:15796:0:(genops.c:885:class_export_put()) final put ffff921876713800/lustre-OST0001_UUID 00000020:00000080:1.0:1788592855.978735:0:15796:0:(genops.c:844:class_export_destroy()) destroying export ffff921876713800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788592855.978742:0:15796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788592855.978835:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921876716800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1788592855.978961:0:15796:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2->MGS 00010000:00010000:1.0:1788592855.978975:0:15796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185b520c00/0xbd314a3362db4917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592855.978986:0:15796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185b520c00/0xbd314a3362db4917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592855.978992:0:15796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788592855.978995:0:15796:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788592855.978997:0:15796:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788592855.979010:0:15796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:1.0:1788592855.979014:0:15796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185b520c00/0xbd314a3362db4917 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db491e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592855.979028:0:15796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592855.979033:0:15796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592855.979050:0:15796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788592855.979052:0:15796:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788592855.979054:0:15796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788592855.979249:0:15796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92184532d000 00010000:00010000:1.0:1788592855.979253:0:15796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff921841495e00/0xbd314a3362db4d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd314a3362db4da1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788592855.979338:0:15796:0:(import.c:65:import_set_state_nolock()) ffff92184532d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788592855.979341:0:15796:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788592855.979343:0:15796:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788592855.979344:0:15796:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788592855.979347:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788592855.979357:0:15796:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff921744778e00 x1875475226056192/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788592863 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788592855.979409:0:15796:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788592855.979413:0:15796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1788592855.979706:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2:3638:1875475226056192:0@lo:250:kworker.0 10000000:01000000:1.0:1788592855.979838:0:15796:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788592855.979845:0:15796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4814 00000020:00000080:1.0:1788592855.979850:0:15796:0:(genops.c:885:class_export_put()) final put ffff921846c66800/ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 00000020:01000000:1.0:1788592855.979865:0:15796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.147@tcp (flags='') 00000020:00000080:1.0:1788592855.979871:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592855.979875:0:15796:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.147@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788592855.979879:0:15796:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff921850ee4d40) has no exports 10000000:01000000:3.0:1788592855.979931:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788592855.980008:0:15796:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.147@tcp: client import never connected 00000100:00080000:1.0:1788592855.980011:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788592855.980013:0:15796:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788592855.980015:0:15796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788592855.980017:0:15796:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788592855.980049:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592855.980053:0:15796:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.147@tcp (uuid ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2) 00000020:01000000:1.0:1788592855.980058:0:15796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788592855.980091:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592855.980095:0:15796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788592855.980100:0:15796:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff921742496000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592855.980105:0:15796:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9217435099c0) has exports, disconnecting them 00000020:00080000:1.0:1788592855.980110:0:15796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff921742496000), last request at 1788592672 00000020:00000080:1.0:1788592855.980114:0:15796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4be8 00000020:00080000:1.0:1788592855.980124:0:15796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff921742496000): rc 0 00000020:00000080:1.0:1788592855.980128:0:15796:0:(genops.c:885:class_export_put()) final put ffff921742496000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788592855.981106:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921846c66800/ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 for MGC192.168.203.147@tcp 00000020:00000080:2.0:1788592855.981119:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92184532d000 for MGC192.168.203.147@tcp 00000020:00000080:2.0:1788592855.981125:0:37:0:(genops.c:885:class_export_put()) final put ffff92184532c000/ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 00000020:00000080:2.0:1788592855.981127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92184532c000/ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2 for MGC192.168.203.147@tcp 00000020:01000000:2.0:1788592855.981132:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.147@tcp (ef3bdaa9-47c5-4e0d-8e26-d4902916fcb2) 00000020:00000080:2.0:1788592855.981403:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921742496000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788592855.982137:0:15796:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788592855.982141:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788592855.982145:0:15796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788592855.982152:0:15796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788592855.982311:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592855.982318:0:15796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788592855.982323:0:15796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788592855.982327:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788592855.982330:0:15796:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788592855.982336:0:15796:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff921875a9a800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788592855.982341:0:15796:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff92174350cd40) has exports, disconnecting them 00000020:00080000:2.0:1788592855.982345:0:15796:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff921875a9a800), last request at 1788592672 00000020:00000080:2.0:1788592855.982348:0:15796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4bfd 00000020:00080000:2.0:1788592855.982362:0:15796:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff921875a9a800): rc 0 00000020:00000080:2.0:1788592855.982367:0:15796:0:(genops.c:885:class_export_put()) final put ffff921875a9a800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788592855.982539:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff921742497800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788592855.982546:0:37:0:(genops.c:885:class_export_put()) final put ffff92186f49f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788592855.982548:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92186f49f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788592855.982553:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788592855.982600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff921875a9a800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788592855.985121:0:15796:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788592855.985129:0:15796:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788592855.985132:0:15796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788592855.985139:0:15796:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788592855.985168:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92186ba51000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788592855.993456:0:7920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788592855.993838:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788592855.997134:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788592855.997330:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff921846646a00:6496] 1 exiting: rc = 0 00000100:00100000:0.0:1788592855.999050:0:10330:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff92187c88e800:10330] 2 exiting: rc = 0 00000100:00100000:0.0:1788592855.999223:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff921842e1d800:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1788592855.999341:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592855.999833:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff921850e2e600:6499] 2 exiting: rc = 0 00000100:00100000:2.0:1788592856.000839:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff92184521c400:6498] 1 exiting: rc = 0 00000100:00100000:3.0:1788592856.004280:0:10331:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff921743755600:10331] 3 exiting: rc = 0 00000100:00100000:3.0:1788592856.004551:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff92184521da00:6497] 0 exiting: rc = 1 00000100:00100000:3.0:1788592856.004634:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004652:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004659:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004665:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004671:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004677:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004681:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004687:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004693:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004698:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004703:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004709:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004722:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004728:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004738:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004744:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004750:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004844:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004851:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004858:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004864:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004870:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004874:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004879:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004884:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004888:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004893:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004898:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004903:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004909:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004913:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004918:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004928:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004933:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004938:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004952:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004957:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004961:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004966:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004971:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004976:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004981:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004986:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004991:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.004996:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005001:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005006:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005011:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005016:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005021:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005026:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005031:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005036:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005041:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005046:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005050:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005054:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005059:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005064:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005095:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005101:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005105:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005110:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.005116:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788592856.020392:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592856.020408:0:15796:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788592856.020415:0:15796:0:(genops.c:885:class_export_put()) final put ffff921742496800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788592856.020419:0:15796:0:(genops.c:844:class_export_destroy()) destroying export ffff921742496800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788592856.020427:0:15796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788592856.020496:0:15796:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92174243f000 1 00000020:00000080:3.0:1788592856.020502:0:15796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd314a3362db4b8d 00000020:00000080:3.0:1788592856.020508:0:15796:0:(genops.c:885:class_export_put()) final put ffff92186f440000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788592856.020520:0:15796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788592856.020531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92186f440000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788592856.020540:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592856.020545:0:15796:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788592856.020549:0:15796:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff92186d59cd40) has no exports 00000020:00000080:3.0:1788592856.059006:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592856.059022:0:15796:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788592856.059027:0:15796:0:(genops.c:885:class_export_put()) final put ffff921742438800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788592856.059032:0:15796:0:(genops.c:844:class_export_destroy()) destroying export ffff921742438800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788592856.059045:0:15796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788592856.059578:0:15796:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92174243d000 00000020:01000000:3.0:1788592856.059600:0:15796:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788592856.059605:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592856.059610:0:15796:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788592856.059613:0:15796:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff92186d5999c0) has no exports 00000020:00000080:3.0:1788592856.059663:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592856.059668:0:15796:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788592856.059672:0:15796:0:(genops.c:885:class_export_put()) final put ffff921875a9f800/OSS_uuid 00000020:00000080:3.0:1788592856.059674:0:15796:0:(genops.c:844:class_export_destroy()) destroying export ffff921875a9f800/OSS_uuid for OSS 00000020:01000000:3.0:1788592856.059678:0:15796:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788592856.059732:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788592856.059769:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff92186b9bb200:8428] 1 exiting: rc = 0 00000100:00100000:3.0:1788592856.059847:0:8590:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff921741dc6e00:8590] 3 exiting: rc = 0 00000100:00100000:3.0:1788592856.059892:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff921876686c00:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1788592856.059955:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff921876687400:8429] 2 exiting: rc = 0 00000100:00100000:0.0:1788592856.060202:0:10091:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff921741dc7e00:10091] 4 exiting: rc = 0 00000100:00100000:3.0:1788592856.060414:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060422:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060428:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060436:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060442:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060447:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060465:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060470:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060476:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060481:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060486:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060490:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060504:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060511:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060516:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060522:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060527:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060532:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060537:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060542:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060547:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060552:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060558:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060563:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060568:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060573:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060577:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060606:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060612:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060618:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060623:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060630:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060635:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060639:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060657:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060663:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060671:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060685:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060692:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060697:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060702:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060714:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060719:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060724:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060730:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060735:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060740:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060746:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060751:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060756:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060762:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060767:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060775:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060779:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060784:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060789:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060794:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060799:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060805:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060810:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060815:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060820:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060831:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.060838:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.061554:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff92187669c400:8430] 0 exiting: rc = 1 00000100:00100000:2.0:1788592856.064417:0:10702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff921743977200:10702] 2 exiting: rc = 0 00000100:00100000:1.0:1788592856.064735:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff92187669c200:8431] 1 exiting: rc = 0 00000100:00100000:3.0:1788592856.064917:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064926:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064933:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064938:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064944:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064949:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064954:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064960:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064965:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064970:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064976:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.064997:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065002:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065007:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065012:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065016:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065022:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065028:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065033:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065038:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065043:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065048:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065053:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065059:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065098:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065107:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065117:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065126:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065131:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065137:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065142:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065148:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065153:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065159:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065164:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065170:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065175:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065180:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065196:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065201:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065370:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065380:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065385:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065390:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065396:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065401:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065415:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065420:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065426:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065432:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065438:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065453:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065458:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065463:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065467:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065472:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065483:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065489:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065494:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065499:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065504:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065510:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065515:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.065520:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592856.067442:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff92186b9ba200:8432] 0 exiting: rc = 1 00000100:00100000:0.0:1788592856.067622:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff921850e2aa00:8433] 1 exiting: rc = 0 00000100:00100000:2.0:1788592856.071971:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff92187669c600:8434] 2 exiting: rc = 0 00000100:00100000:0.0:1788592856.072392:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072402:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072408:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072428:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072434:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072449:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072454:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072459:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072465:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072471:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072484:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072490:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072496:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072501:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072507:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072520:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072526:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072532:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072538:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072545:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072559:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072566:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072572:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072578:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072591:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072597:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072603:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072632:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072640:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072645:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072650:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072663:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072670:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072675:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072698:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072703:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072708:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072714:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072733:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072739:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072744:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072755:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072761:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072767:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072772:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072777:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072789:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072795:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072800:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072806:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072812:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072824:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072829:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072835:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072841:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072862:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072868:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072881:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072889:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072894:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072898:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072903:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072908:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.072921:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.076972:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff92187144b400:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1788592856.077265:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff92187144be00:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1788592856.077374:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077382:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077387:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077393:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077398:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077402:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077407:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077412:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077432:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077437:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077441:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077446:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077452:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077464:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077469:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077474:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077479:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077484:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077489:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077502:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077507:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077512:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077517:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077522:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077527:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077538:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077543:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077549:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077554:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077559:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077564:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077575:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077580:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077585:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077590:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077595:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077607:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077612:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077616:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077621:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077626:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077631:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077641:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077654:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077659:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077671:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077677:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077681:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077686:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077691:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077696:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077701:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077713:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077719:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077724:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077728:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077733:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077737:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077748:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077753:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077758:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077762:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077767:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592856.077778:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592856.078901:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff92187d772400:8437] 0 exiting: rc = 1 00000100:00100000:1.0:1788592856.079379:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff92187d773000:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1788592856.079583:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079601:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079614:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079622:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079635:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079641:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079647:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079679:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079687:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079701:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079710:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079717:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079722:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079733:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079740:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079745:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079751:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079775:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079781:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079809:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079817:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079822:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079828:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079842:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079848:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079853:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079859:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079864:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079870:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079883:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079889:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079917:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079925:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079931:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079937:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079943:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079949:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079963:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079969:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079975:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079981:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.079995:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080001:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080022:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080037:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080043:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080049:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080056:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080062:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080205:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080212:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080219:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080233:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080239:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080254:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080275:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080285:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080291:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080297:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080303:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080308:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080314:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080321:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592856.080334:0:15796:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788592856.092773:0:15796:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788592871.563571:0:16559:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788592880.684298:0:17159:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788592880.684308:0:17159:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788592880.684310:0:17159:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788592880.684450:0:17159:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92174444b000 00000020:01000004:2.0:1788592880.684467:0:17159:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788592880.684476:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788592880.684496:0:17159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff921743508000) 00000020:00000080:2.0:1788592880.684517:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788592880.774464:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788592880.775451:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788592880.778564:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788592880.779372:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788592880.779616:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788592880.779922:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788592880.780412:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788592880.780659:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788592880.781129:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788592880.781470:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788592880.782425:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788592880.782880:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788592880.783485:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788592880.783723:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788592880.784894:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788592880.785141:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.785551:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.785944:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.786524:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.786757:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.787058:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.787429:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.787645:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.787904:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.788255:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.788512:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.788689:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.788957:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.789133:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.789359:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.789513:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.789732:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.790004:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.790383:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.790593:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.790931:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.791289:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.791536:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.791885:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.792137:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.792360:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.792518:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.793053:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788592880.793302:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.793544:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.793907:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788592880.799244:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788592880.799952:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788592880.801367:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788592880.801653:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788592880.802227:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788592880.802461:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788592880.802738:0:17159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1788592880.803796:0:17159:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788592880.805856:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788592880.805867:0:17159:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788592880.805880:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5dd1 00000020:01000004:1.0:1788592880.805888:0:17159:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788592880.805893:0:17159:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788592880.805898:0:17159:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92174444b000 from MGS 00000020:01000004:1.0:1788592880.805901:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788592880.805916:0:17159:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff92186d598000) 00000020:00000080:1.0:1788592880.805927:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788592880.806000:0:17159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92174444b000 from MGS, refs=2 00080000:01000000:1.0:1788592880.806006:0:17159:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788592880.806011:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5ddf 00000100:00100000:1.0:1788592880.806154:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788592880.806291:0:17159:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788592880.806297:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788592880.808305:0:17159:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788592880.808315:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788592880.809243:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592880.809410:0:17159:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788592880.809416:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788592880.811428:0:17159:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788592880.811441:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788592880.811823:0:17159:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788592880.811830:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788592880.812905:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592880.812910:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592880.812912:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592880.815153:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592880.815158:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592880.815174:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592880.815800:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788592880.818725:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788592880.829880:0:17159:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788592880.831586:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788592880.831689:0:17159:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788592880.831728:0:17159:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592880.833159:0:17159:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788592880.833480:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592880.833652:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788592880.833658:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788592880.835310:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788592880.835320:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788592880.835899:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788592880.835904:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788592880.836653:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788592880.836672:0:17159:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.147@tcp' 00000020:01000004:2.0:1788592880.836674:0:17159:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788592880.836704:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.147@tcp (typ=mgc) 00000020:00000080:2.0:1788592880.836717:0:17159:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.147@tcp (ffff92174350b380) 00000020:00000080:2.0:1788592880.836732:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788592880.836811:0:17159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9218764bb800@MGC192.168.203.147@tcp: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592880.836975:0:17159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.147@tcp-0 is initialized 00000040:01000000:2.0:1788592880.836981:0:17159:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788592880.839200:0:17177:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788592880.839251:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.147@tcp (uuid 70647b28-81c8-4371-870a-35a99a7dd483) 00000020:00000080:2.0:1788592880.839269:0:17159:0:(genops.c:1385:class_connect()) connect: client 70647b28-81c8-4371-870a-35a99a7dd483, cookie 0xbd314a3362db5ded 00000100:00080000:2.0:1788592880.839281:0:17159:0:(import.c:545:import_select_connection()) MGC192.168.203.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592880.839287:0:17159:0:(import.c:665:import_select_connection()) MGC192.168.203.147@tcp: import ffff9218764bb800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592880.839319:0:17159:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d509c00 x1875475226056704/t0(0) o250->MGC192.168.203.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592880.839365:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:70647b28-81c8-4371-870a-35a99a7dd483:3638:1875475226056704:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788592880.839453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592880.839494:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226056704 00000100:00100000:1.0:1788592880.839501:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226056704 00000100:00080000:2.0:1788592880.839512:0:17159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 70647b28-81c8-4371-870a-35a99a7dd483->MGS 00000100:00100000:1.0:1788592880.839530:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1788592880.839532:0:17159:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788592880.839536:0:17159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:1.0:1788592880.839538:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1875475226056704:12345-0@lo:250:mount.lustre.0 00000020:00000080:2.0:1788592880.839550:0:17159:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff92174350cd40) 00010000:00080000:1.0:1788592880.839558:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 70647b28-81c8-4371-870a-35a99a7dd483@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:2.0:1788592880.839561:0:17159:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000020:00000080:1.0:1788592880.839578:0:17172:0:(genops.c:1385:class_connect()) connect: client 70647b28-81c8-4371-870a-35a99a7dd483, cookie 0xbd314a3362db5dfb 00000100:00080000:1.0:1788592880.839707:0:17172:0:(import.c:65:import_set_state_nolock()) ffff9218759fa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592880.839758:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+5:3638:x1875475226056704:12345-0@lo:250:mount.lustre.0 Request processed in 220us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592880.839765:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592880.839806:0:3638:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788592880.839813:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.147@tcp: connect to target with instance 0 00000100:00080000:1.0:1788592880.839819:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788592880.839823:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788592880.839832:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218764bb800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788592880.839835:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788592880.839838:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788592880.839842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:70647b28-81c8-4371-870a-35a99a7dd483:3638:1875475226056704:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788592880.840133:0:17176:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788592880.847641:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592880.848050:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788592880.848058:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788592880.850331:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788592880.850343:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788592880.852414:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788592880.852424:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788592880.853313:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592880.853484:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788592880.853489:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788592880.854025:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788592880.854032:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788592880.892493:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592880.892813:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788592880.892821:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788592880.896052:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788592880.896089:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788592880.896994:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592880.897546:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788592880.897552:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788592880.898368:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788592880.898375:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788592880.899028:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592880.899438:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788592880.899444:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788592880.900364:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788592880.900373:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788592880.900939:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592880.901296:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788592880.901301:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788592880.902012:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788592880.902028:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788592880.928560:0:17159:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592880.928773:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788592880.928780:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788592880.936216:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788592880.936234:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788592880.937205:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788592880.937214:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788592880.938062:0:17159:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788592880.938209:0:17159:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788592880.938217:0:17159:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788592880.938333:0:17159:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788592880.938364:0:17159:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788592880.938368:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788592880.938370:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788592880.938371:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592880.938372:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592880.938373:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592880.938374:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592880.938375:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788592880.938376:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788592880.938378:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592880.938379:0:17159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592880.938381:0:17159:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788592880.938383:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788592880.938384:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788592880.938389:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592880.938390:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592880.938391:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592880.938392:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592880.938392:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788592880.938393:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788592880.938394:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592880.938395:0:17159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592880.938428:0:17159:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788592880.938446:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226056832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788592880.938520:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.938559:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592880.938725:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226056832 00000100:00100000:1.0:1788592880.938733:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226056832 00000100:00100000:1.0:1788592880.938795:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592880.938805:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+5:17159:x1875475226056832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788592880.938849:0:17175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592880.938851:0:17175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788592880.938854:0:17175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788592880.939342:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788592880.939773:0:17175:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788592880.942683:0:17196:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788592880.942691:0:17196:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788592880.942694:0:17196:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788592880.942697:0:17196:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788592880.943376:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788592880.944360:0:17175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592880.944370:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788592880.946254:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+5:17159:x1875475226056832:12345-0@lo:253:mount.lustre.0 Request processed in 7444us (7727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592880.946266:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592880.946388:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226056832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788592880.946404:0:17159:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788592880.946407:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788592880.946409:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788592880.946410:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592880.946412:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592880.946413:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592880.946414:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592880.946416:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788592880.946417:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788592880.946419:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592880.946420:0:17159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788592880.946439:0:17159:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92174444b000 from lustre-MDT0000 10000000:01000000:3.0:1788592880.946468:0:17159:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788592880.946471:0:17159:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788592880.946476:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92174350b380 10000000:01000000:3.0:1788592880.946480:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592880.946548:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92174350b380 from 1 10000000:01000000:3.0:1788592880.946552:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788592880.946586:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.946599:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.946620:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592880.946639:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226056960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592880.946676:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.946744:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592880.946786:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226056960 00000100:00100000:1.0:1788592880.946792:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226056960 00000100:00100000:1.0:1788592880.946862:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592880.946871:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+5:17159:x1875475226056960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592880.946883:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592880.946898:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022ae00/0xbd314a3362db5e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5e02 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592880.946918:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022ae00/0xbd314a3362db5e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5e02 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592880.946928:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022ae00/0xbd314a3362db5e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5e02 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592880.946945:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022ae00, rc 0) 00000100:00100000:1.0:1788592880.946984:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+6:17159:x1875475226056960:12345-0@lo:101:mount.lustre.0 Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592880.946999:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592880.947095:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226056960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592880.947110:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.947119:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592880.947169:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592880.947196:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.947394:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592880.947426:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057088 00000100:00100000:2.0:1788592880.947431:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057088 00000100:00100000:2.0:1788592880.947452:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592880.947459:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+6:17159:x1875475226057088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592880.947593:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+6:17159:x1875475226057088:12345-0@lo:501:mount.lustre.0 Request processed in 134us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592880.947611:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592880.947715:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057088:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788592880.947741:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788592880.947755:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.947761:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592880.947767:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92174444b000 10000000:01000000:3.0:1788592880.947770:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788592880.947777:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92174444b000 10000000:01000000:3.0:1788592880.947779:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788592880.947781:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92174444b000 from 1 10000000:01000000:3.0:1788592880.947783:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788592880.947796:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.947800:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.947806:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592880.947814:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592880.947832:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.947841:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592880.947896:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057216 00000100:00100000:2.0:1788592880.947900:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057216 00000100:00100000:1.0:1788592880.947927:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592880.947936:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+6:17159:x1875475226057216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592880.947944:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592880.947958:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022a600/0xbd314a3362db5e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5e10 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592880.947987:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022a600/0xbd314a3362db5e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5e10 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592880.947996:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022a600/0xbd314a3362db5e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5e10 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592880.948003:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a600, rc 0) 00000100:00100000:1.0:1788592880.948054:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+7:17159:x1875475226057216:12345-0@lo:101:mount.lustre.0 Request processed in 119us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592880.948060:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592880.948103:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592880.948114:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e17 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.948122:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5e17 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592880.948133:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788592880.948142:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e17 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.948148:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205e800/0xbd314a3362db5e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e17 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592880.948165:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788592880.948168:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592880.948172:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92174444b000 10000000:01000000:3.0:1788592880.948175:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788592880.948178:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788592880.948180:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788592880.948195:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.948202:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.948209:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592880.948273:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592880.948292:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.948309:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592880.948386:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057344 00000100:00100000:0.0:1788592880.948390:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057344 00000100:00100000:0.0:1788592880.948422:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592880.948429:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+7:17159:x1875475226057344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592880.948436:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592880.948445:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f1200/0xbd314a3362db5e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5e1e expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592880.948459:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f1200/0xbd314a3362db5e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5e1e expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592880.948467:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f1200/0xbd314a3362db5e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5e1e expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592880.948473:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1200, rc 0) 00000100:00100000:0.0:1788592880.948610:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+8:17159:x1875475226057344:12345-0@lo:101:mount.lustre.0 Request processed in 181us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592880.948617:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592880.948739:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592880.948747:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e25 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592880.948753:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5e25 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592880.948784:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592880.948800:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.948820:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592880.948848:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057472 00000100:00100000:1.0:1788592880.948852:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057472 00000100:00100000:1.0:1788592880.948880:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788592880.948887:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+8:17159:x1875475226057472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592880.949143:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+9:17159:x1875475226057472:12345-0@lo:501:mount.lustre.0 Request processed in 128us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592880.949160:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592880.949314:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592880.949339:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592880.949375:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.949402:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592880.949451:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057600 00000100:00100000:1.0:1788592880.949456:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057600 00000100:00100000:1.0:1788592880.949642:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592880.949650:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+9:17159:x1875475226057600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592880.950913:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+9:17159:x1875475226057600:12345-0@lo:503:mount.lustre.0 Request processed in 1261us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592880.950922:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592880.951124:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226057600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592880.952325:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17197:1875475226057728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592880.952396:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592880.952494:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff921842c28000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592880.952799:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057728 00000100:00100000:1.0:1788592880.952806:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057728 00000100:00100000:1.0:1788592880.952946:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592880.952955:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+9:17197:x1875475226057728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592880.954945:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+9:17197:x1875475226057728:12345-0@lo:502:llog_process_th.0 Request processed in 1983us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592880.954958:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788592880.955103:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17197:1875475226057728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592880.955137:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592880.955146:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592880.955149:0:17197:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788592880.955154:0:17197:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788592880.955157:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592880.955170:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff921742aa0000) 00000020:00000080:3.0:1788592880.955185:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788592880.955188:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788592880.955293:0:17197:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788592880.955299:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5e33 00000020:00000080:3.0:1788592880.955749:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788592880.955753:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592880.955757:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592880.955758:0:17197:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788592880.955761:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592880.955764:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592880.955766:0:17197:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788592880.955768:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592880.955781:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff921742aa3380) 00000020:00000080:3.0:1788592880.955790:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788592880.955794:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788592880.955796:0:17197:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788592880.955798:0:17197:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788592880.955803:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788592880.955852:0:17197:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92174444b000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788592880.955862:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff921742aa19c0) 00000020:00000080:3.0:1788592880.955870:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788592880.955915:0:17197:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788592880.955920:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db5e48 00000020:00000080:3.0:1788592880.956012:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788592880.956029:0:17197:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788592880.956035:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbd314a3362db5e4f 00080000:01000000:3.0:1788592880.956039:0:17197:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788592880.956043:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5e56 00010000:00010000:3.0:1788592881.079323:0:17197:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788592881.083387:0:17197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788592881.085290:0:17197:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788592881.085750:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff921742aa4d40) 00000020:00000080:3.0:1788592881.085769:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788592881.085842:0:17197:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788592881.085848:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5e64 00000020:00000080:2.0:1788592881.093561:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788592881.098239:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbd314a3362db5e6b 00000020:00000080:2.0:1788592881.098760:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788592881.098773:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592881.098780:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592881.098782:0:17197:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788592881.098786:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788592881.098789:0:17197:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788592881.098791:0:17197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788592881.098792:0:17197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788592881.098793:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788592881.098796:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592881.098798:0:17197:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788592881.098800:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592881.098804:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592881.098806:0:17197:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788592881.098811:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788592881.098846:0:17197:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788592881.098860:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592881.098863:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592881.098865:0:17197:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788592881.098867:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592881.098870:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592881.098872:0:17197:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788592881.098874:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592881.098887:0:17197:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:2.0:1788592881.098913:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592881.098927:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9217435099c0) 00000020:00000080:2.0:1788592881.098940:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788592881.098945:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592881.099011:0:17197:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788592881.099030:0:17197:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788592881.099036:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5e79 00010000:00080000:2.0:1788592881.099097:0:17197:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92186f447800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592881.105414:0:17197:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788592881.111802:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788592881.111820:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788592881.111866:0:17197:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788592881.111888:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db5e80 00000100:00080000:0.0:1788592881.111899:0:17197:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592881.111907:0:17197:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92186f447800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592881.111944:0:17197:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174477a680 x1875475226057856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788592881.111971:0:17197:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788592881.112105:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226057856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592881.112175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592881.112815:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226057856 00000100:00100000:3.0:1788592881.112823:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226057856 00000020:01000000:1.0:1788592881.112827:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592881.112832:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592881.112833:0:17197:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788592881.112837:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788592881.112839:0:17197:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788592881.112841:0:17197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788592881.112842:0:17197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788592881.112844:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788592881.112846:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592881.112848:0:17197:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788592881.112851:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788592881.112855:0:17197:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788592881.112858:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592881.112860:0:17197:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:3.0:1788592881.112868:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:00000080:1.0:1788592881.112869:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788592881.112873:0:17197:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000100:00100000:3.0:1788592881.112875:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226057856:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788592881.112889:0:17184:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:1.0:1788592881.112901:0:17197:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788592881.112903:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592881.112915:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92186d59b380) 00000020:00000080:1.0:1788592881.112927:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788592881.112933:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788592881.112940:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226057856:12345-0@lo:38:llog_process_th.0 Request processed in 65us (765us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592881.112947:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1788592881.113000:0:17197:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788592881.113006:0:17197:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000100:00080000:2.0:1788592881.113205:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592881.113211:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592881.113215:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226057856:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788592881.113670:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5e8e 00010000:00080000:1.0:1788592881.113704:0:17197:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9218696ac800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:1.0:1788592881.113914:0:17197:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788592881.115779:0:17197:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788592881.115985:0:17197:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788592881.123938:0:17197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592881.124345:0:17197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788592881.130889:0:17197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788592881.131738:0:17203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788592881.131743:0:17203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788592881.132687:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788592881.132701:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788592881.132748:0:17197:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788592881.132769:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db5e95 00000100:00080000:0.0:1788592881.132778:0:17197:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592881.132785:0:17197:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9218696ac800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592881.132818:0:17197:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744779500 x1875475226057984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592881.132871:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226057984:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788592881.132927:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226057984 offset 0 length 520: 4 00000100:00080000:0.0:1788592881.133042:0:17197:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788592881.133182:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592881.133186:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.133188:0:17197:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788592881.133191:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788592881.133194:0:17197:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788592881.133195:0:17197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788592881.133196:0:17197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788592881.133198:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788592881.133200:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.133201:0:17197:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788592881.133203:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788592881.133213:0:17197:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788592881.133217:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.133218:0:17197:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788592881.133222:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788592881.133225:0:17197:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:0.0:1788592881.133246:0:17197:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788592881.133248:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592881.133259:0:17197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9218475499c0) 00000020:00000080:0.0:1788592881.133270:0:17197:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788592881.133275:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788592881.133332:0:17197:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788592881.133338:0:17197:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788592881.133343:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd314a3362db5ea3 00010000:00080000:0.0:1788592881.133371:0:17197:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92187c937800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1788592881.133581:0:17197:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788592881.133658:0:17197:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788592881.133671:0:17197:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788592881.134934:0:17197:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:0.0:1788592881.136404:0:17197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592881.136755:0:17197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788592881.136902:0:17197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788592881.137507:0:17205:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1788592881.137511:0:17205:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788592881.141327:0:17197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788592881.141342:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788592881.141381:0:17197:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788592881.141401:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db5eaa 00000100:00080000:0.0:1788592881.141411:0:17197:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592881.141417:0:17197:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592881.141574:0:17197:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744778700 x1875475226058112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592881.141734:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226058112:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788592881.141788:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226058112 offset 0 length 520: 4 00000100:00080000:0.0:1788592881.141842:0:17197:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788592881.141916:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592881.141921:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.141923:0:17197:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788592881.141926:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592881.141930:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.141931:0:17197:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788592881.141935:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788592881.141936:0:17197:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788592881.141938:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592881.141941:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.141942:0:17197:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788592881.141944:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592881.141946:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592881.141947:0:17197:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788592881.141951:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788592881.141991:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17197:1875475226058240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592881.142050:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592881.142089:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.142256:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226058240 00000100:00100000:1.0:1788592881.142265:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226058240 00000100:00100000:1.0:1788592881.142312:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592881.142321:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+9:17197:x1875475226058240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592881.142447:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+9:17197:x1875475226058240:12345-0@lo:502:llog_process_th.0 Request processed in 126us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592881.142463:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592881.142535:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17197:1875475226058240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592881.142560:0:17197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592881.142565:0:17197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592881.142567:0:17197:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788592881.142571:0:17197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788592881.142627:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788592881.142651:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788592881.142666:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e25 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.142676:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205fa00/0xbd314a3362db5e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e25 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592881.142684:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92174444b000 from 1 10000000:01000000:1.0:1788592881.142687:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788592881.142713:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.142722:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.142731:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.142745:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788592881.142773:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592881.142794:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592881.143265:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226058368 00000100:00100000:0.0:1788592881.143271:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226058368 00000100:00100000:0.0:1788592881.143302:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788592881.143309:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+9:17159:x1875475226058368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592881.143318:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592881.143333:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5eb1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.143352:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 10 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.143363:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 10 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.143383:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0200, rc 0) 00000100:00100000:0.0:1788592881.143417:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+10:17159:x1875475226058368:12345-0@lo:101:mount.lustre.0 Request processed in 109us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.143422:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592881.143555:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592881.143567:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.143576:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.144290:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058496:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788592881.144366:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592881.144400:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592881.144471:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226058496 00000100:00100000:0.0:1788592881.144476:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226058496 00000100:00100000:0.0:1788592881.144509:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592881.144704:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+10:17159:x1875475226058496:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788592881.144720:0:17172:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788592881.144727:0:17172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788592881.144805:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+10:17159:x1875475226058496:12345-0@lo:256:mount.lustre.0 Request processed in 105us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.145355:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058496:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788592881.145955:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592881.146194:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.146206:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592881.146226:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174444b000 from 1 10000000:01000000:2.0:1788592881.146228:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592881.146268:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.146276:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.146284:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.146303:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592881.146351:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.146383:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592881.146408:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226058624 00000100:00100000:2.0:1788592881.146414:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226058624 00000100:00100000:0.0:1788592881.146759:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592881.146863:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592881.146872:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+10:17159:x1875475226058624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592881.146883:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592881.146902:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5ebf expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.146922:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.146931:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.146949:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e800, rc 0) 00000100:00100000:2.0:1788592881.146998:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+11:17159:x1875475226058624:12345-0@lo:101:mount.lustre.0 Request processed in 128us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.147004:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592881.147086:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592881.147100:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.147109:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.147171:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592881.147196:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592881.147463:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218766719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.147658:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226058752 00000100:00100000:1.0:1788592881.147664:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226058752 00000100:00100000:2.0:1788592881.147703:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592881.147711:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+11:17159:x1875475226058752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592881.147846:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+11:17159:x1875475226058752:12345-0@lo:501:mount.lustre.0 Request processed in 137us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.147853:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592881.147911:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592881.147939:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592881.147988:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592881.148223:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218766719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592881.148254:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226058880 00000100:00100000:0.0:1788592881.148259:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226058880 00000100:00100000:0.0:1788592881.148279:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592881.148284:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17159:x1875475226058880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592881.148366:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17159:x1875475226058880:12345-0@lo:503:mount.lustre.0 Request processed in 80us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.148373:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592881.148474:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226058880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592881.149112:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17207:1875475226059008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592881.149151:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592881.149174:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671900 going to sleep for 11 seconds 00000100:00100000:0.0:1788592881.149225:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059008 00000100:00100000:0.0:1788592881.149230:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059008 00000100:00100000:0.0:1788592881.149252:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592881.149258:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17207:x1875475226059008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592881.149787:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17207:x1875475226059008:12345-0@lo:502:llog_process_th.0 Request processed in 527us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.149801:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592881.149892:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17207:1875475226059008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592881.149915:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592881.149924:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.149926:0:17207:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788592881.149934:0:17207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92174444b000 00000020:00000080:3.0:1788592881.149936:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592881.149943:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592881.149946:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.149953:0:17207:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788592881.149956:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592881.149958:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.149959:0:17207:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788592881.149962:0:17207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92174444b000 00000020:00000080:3.0:1788592881.149964:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592881.150123:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592881.150127:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.150128:0:17207:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788592881.150131:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592881.150133:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.150134:0:17207:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592881.150138:0:17207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92174444b000 00000020:00000080:3.0:1788592881.150140:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592881.150156:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592881.150159:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.150160:0:17207:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592881.150162:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592881.150164:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.150165:0:17207:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788592881.150167:0:17207:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92174444b000 00000020:00000080:3.0:1788592881.150169:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788592881.150202:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17207:1875475226059136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592881.150239:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592881.150261:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592881.151149:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059136 00000100:00100000:3.0:1788592881.151155:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059136 00000100:00100000:3.0:1788592881.151184:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592881.151192:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17207:x1875475226059136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592881.151301:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17207:x1875475226059136:12345-0@lo:502:llog_process_th.0 Request processed in 109us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.151316:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592881.151358:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17207:1875475226059136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592881.151380:0:17207:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592881.151385:0:17207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592881.151387:0:17207:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788592881.151391:0:17207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788592881.152307:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788592881.152329:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592881.153603:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.153617:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592881.153677:0:17159:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788592881.153681:0:17159:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92174444b000 10000000:01000000:2.0:1788592881.153683:0:17159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92174444b000 10000000:01000000:2.0:1788592881.153687:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592881.153693:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92174444b000 from 1 10000000:01000000:2.0:1788592881.153696:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592881.153728:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.153738:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.153754:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.153775:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226059264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592881.153829:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.153866:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217427196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592881.156332:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059264 00000100:00100000:3.0:1788592881.156345:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059264 00000100:00100000:3.0:1788592881.156418:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592881.156429:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+11:17159:x1875475226059264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592881.156444:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592881.157180:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205f400/0xbd314a3362db5ed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5ecd expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.157212:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f400/0xbd314a3362db5ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5ecd expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.157224:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205f400/0xbd314a3362db5ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ecd expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.157238:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205f400, rc 0) 00000100:00100000:3.0:1788592881.157315:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226059264:12345-0@lo:101:mount.lustre.0 Request processed in 889us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.157322:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788592881.157745:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226059264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592881.157763:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ed4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.157774:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5ed4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.157844:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226059392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592881.157876:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.157917:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217427196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.158092:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059392 00000100:00100000:1.0:1788592881.158097:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059392 00000100:00100000:1.0:1788592881.158125:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592881.158133:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226059392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592881.158246:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226059392:12345-0@lo:501:mount.lustre.0 Request processed in 112us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592881.158253:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592881.159105:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226059392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592881.159139:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226059520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592881.159179:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.159207:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217427196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592881.159344:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059520 00000100:00100000:3.0:1788592881.159349:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059520 00000100:00100000:3.0:1788592881.159386:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788592881.159393:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226059520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592881.159491:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226059520:12345-0@lo:503:mount.lustre.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.159498:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592881.159725:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226059520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592881.165818:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17209:1875475226059648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592881.165894:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.165937:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719540 going to sleep for 11 seconds 00000100:00100000:3.0:1788592881.166834:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059648 00000100:00100000:3.0:1788592881.166843:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059648 00000100:00100000:3.0:1788592881.166931:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592881.166941:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17209:x1875475226059648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592881.167172:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17209:x1875475226059648:12345-0@lo:502:llog_process_th.0 Request processed in 231us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.167180:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592881.174362:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17209:1875475226059648:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788592881.174444:0:17209:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788592881.174459:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff92187d788000) 00000020:00000080:2.0:1788592881.174478:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788592881.174627:0:17209:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92174444b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788592881.174631:0:17209:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92174444b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788592881.174634:0:17209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92174444b000 4 00010000:00080000:2.0:1788592881.174663:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9217439b8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592881.176170:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788592881.176350:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788592881.176387:0:17209:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592881.176399:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbd314a3362db5ee2 00000100:00080000:2.0:1788592881.176408:0:17209:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592881.176413:0:17209:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9217439b8000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592881.176446:0:17209:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d50aa00 x1875475226059776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592881.176479:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788592881.176834:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475226059776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788592881.176910:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.177145:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059776 00000100:00100000:2.0:1788592881.177152:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059776 00000100:00100000:2.0:1788592881.177219:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592881.177227:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475226059776:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788592881.177283:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1875475226059776:12345-0@lo:38:llog_process_th.0 Request processed in 55us (372us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788592881.177290:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592881.177366:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592881.177374:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9217439b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592881.177377:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788592881.177380:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475226059776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788592881.183949:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17209:1875475226059904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592881.185608:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.185650:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.185766:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226059904 00000100:00100000:1.0:1788592881.185774:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226059904 00000100:00100000:1.0:1788592881.185824:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592881.185832:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+12:17209:x1875475226059904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592881.185948:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+12:17209:x1875475226059904:12345-0@lo:502:llog_process_th.0 Request processed in 117us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592881.185956:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592881.186046:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17209:1875475226059904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592881.186116:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17209:1875475226060032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592881.186155:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.186175:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060032 00000100:00100000:2.0:1788592881.186178:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060032 00000100:00100000:2.0:1788592881.186549:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592881.186557:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17209:x1875475226060032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592881.186627:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17209:x1875475226060032:12345-0@lo:502:llog_process_th.0 Request processed in 71us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.186634:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592881.188599:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.188638:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:70647b28-81c8-4371-870a-35a99a7dd483:17209:1875475226060032:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788592881.188680:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788592881.188937:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788592881.188960:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592881.188985:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ed4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.188997:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820fe00/0xbd314a3362db5ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ed4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788592881.189055:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788592881.189057:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592881.189058:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592881.189060:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592881.189061:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592881.189062:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592881.189063:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592881.189091:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592881.189093:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592881.189094:0:17159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592881.189098:0:17159:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788592881.189100:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592881.189101:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592881.189102:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592881.189103:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592881.189104:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592881.189104:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592881.189105:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592881.189106:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592881.189107:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592881.189108:0:17159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592881.189127:0:17159:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788592881.189144:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226060160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788592881.189201:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592881.189227:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592881.189363:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060160 00000100:00100000:3.0:1788592881.189371:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060160 00000100:00100000:3.0:1788592881.189414:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788592881.189422:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226060160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788592881.189448:0:17172:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788592881.189462:0:17172:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788592881.191698:0:17172:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788592881.191719:0:17172:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788592881.191992:0:17195:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592881.191998:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592881.192037:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.192056:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.192086:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.192130:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.192146:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.192159:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226060288:0@lo:104: 00000100:00100000:3.0:1788592881.192221:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592881.192266:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592881.192509:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060288 00000100:00100000:0.0:1788592881.192516:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060288 00000100:00100000:0.0:1788592881.192572:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592881.192582:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226060288:12345-0@lo:104: 00010000:00010000:0.0:1788592881.192594:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.192652:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592881.192659:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226060288:12345-0@lo:104: Request processed in 78us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.192665:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592881.192719:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226060288:0@lo:104: 00010000:00010000:1.0:1788592881.192734:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.193190:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:17159:x1875475226060160:12345-0@lo:253:mount.lustre.0 Request processed in 3768us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.193199:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788592881.193363:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592881.193368:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.193382:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:1.0:1788592881.193384:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.193390:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592881.193395:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592881.193398:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592881.193427:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.193433:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592881.193466:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.193473:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185022be00/0xbd314a3362db5eb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5eb8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.193475:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70647b28-81c8-4371-870a-35a99a7dd483:3640:1875475226060416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592881.193488:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592881.193490:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592881.193491:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592881.193504:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592881.193661:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17159:1875475226060160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788592881.193671:0:17159:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788592881.193675:0:17159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592881.193676:0:17159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788592881.193678:0:17159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592881.193679:0:17159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592881.193680:0:17159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592881.193681:0:17159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592881.193687:0:17159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592881.193688:0:17159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788592881.193690:0:17159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592881.193691:0:17159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788592881.193702:0:17159:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788592881.195694:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060416 00000100:00100000:3.0:1788592881.195707:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060416 00010000:00010000:3.0:1788592881.195742:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.195778:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592881.195788:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70647b28-81c8-4371-870a-35a99a7dd483+12:3640:x1875475226060416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592881.195802:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592881.195808:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195822:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195852:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f0200/0xbd314a3362db5eb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db5eb1 expref: 12 pid: 17172 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195869:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195877:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788592881.195893:0:17165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003895772s 00010000:00010000:3.0:1788592881.195897:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195905:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195912:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195919:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195925:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592881.195930:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195938:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195955:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.195974:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592881.196115:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70647b28-81c8-4371-870a-35a99a7dd483+11:3640:x1875475226060416:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.196122:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788592881.196147:0:17195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.196155:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.196162:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f000/0xbd314a3362db5ee9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.196594:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70647b28-81c8-4371-870a-35a99a7dd483:3640:1875475226060416:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788592881.211878:0:17159:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:3.0:1788592881.215689:0:17219:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788592881.215696:0:17219:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788592881.216205:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788592881.216527:0:17220:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788592881.216669:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788592881.217343:0:17221:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff92186d508e00 x1875475226060544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592881.217356:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000040:01000000:1.0:1788592881.217709:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788592881.217749:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592881.218243:0:17220:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788592881.220867:0:17159:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788592881.221038:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788592881.221143:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592881.221984:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788592881.222053:0:17220:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788592881.222777:0:17159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788592881.223577:0:17159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788592881.223625:0:17159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788592881.225782:0:17159:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788592881.227681:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788592881.231404:0:17159:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788592881.231445:0:17159:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb76c819e7988 00100000:10000000:2.0:1788592881.231453:0:17159:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788592881.232229:0:17159:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592881.232247:0:17159:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592881.232279:0:17159:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788592881.232303:0:17159:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788592881.232953:0:17159:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592881.233177:0:17159:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788592881.848448:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788592882.232147:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788592882.232158:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92174444b000 from 7 10000000:01000000:3.0:1788592882.232165:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592882.232226:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.232241:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.232255:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.232290:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226060672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592882.232386:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592882.232448:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592882.232597:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060672 00000100:00100000:2.0:1788592882.232613:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060672 00000100:00100000:2.0:1788592882.232677:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592882.232687:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+11:17177:x1875475226060672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592882.232702:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592882.232718:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5ef0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.232746:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.232757:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.232768:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820ee00, rc 0) 00000100:00100000:2.0:1788592882.232816:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17177:x1875475226060672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.232823:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788592882.232974:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000100:00100000:3.0:1788592882.233021:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226060672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592882.233038:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.233048:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.233149:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226060800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788592882.233191:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592882.233216:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592882.233341:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060800 00000100:00100000:2.0:1788592882.233347:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060800 00000100:00100000:2.0:1788592882.233386:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592882.233393:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:17177:x1875475226060800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788592882.233410:0:17172:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788592882.233428:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788592882.233431:0:17172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788592882.234003:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:17177:x1875475226060800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 606us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.234021:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592882.234707:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226060800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788592882.234787:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788592882.234800:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.234814:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592882.235357:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788592882.874139:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592883.257740:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000040:00080000:1.0:1788592883.262015:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788592883.900412:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592884.280176:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00010000:00010000:0.0:1788592884.920886:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592884.945598:0:17463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788592885.311092:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000020:00000004:3.0:1788592885.749711:0:17515:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592885.750153:0:17515:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788592885.950192:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592886.329133:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000020:00000004:0.0:1788592886.559941:0:17565:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592886.560627:0:17565:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788592886.586632:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226060928:0@lo:400:kworker.0 00000100:00100000:1.0:1788592886.586705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592886.588913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788592886.588923:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788592886.588927:0:37:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592886.588935:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1788592886.588940:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788592886.588947:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92186f447800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592886.588988:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d509f80 x1875475226061056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592886.589002:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592886.589005:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592886.589008:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592886.589010:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592886.589013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788592886.589016:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788592886.589017:0:37:0:(import.c:65:import_set_state_nolock()) ffff9217439b8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592886.589022:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9217439b8000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592886.589033:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d50b480 x1875475226061184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592886.589089:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061056:0@lo:38:kworker.0 00000100:00100000:2.0:1788592886.589149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592886.589178:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475226061184:0@lo:38:kworker.0 00000100:00100000:2.0:1788592886.589201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592886.589280:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226061056 00000100:00100000:2.0:1788592886.589292:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226061056 00000100:00100000:2.0:1788592886.589326:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592886.589333:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226061056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788592886.589349:0:17184:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788592886.593146:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060928 00000100:00100000:0.0:1788592886.593160:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060928 00000100:00100000:0.0:1788592886.593233:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788592886.593243:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:3641:x1875475226060928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592886.593425:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226061184 00000100:00100000:3.0:1788592886.593431:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226061184 00000100:00100000:3.0:1788592886.593463:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592886.593468:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1875475226061184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788592886.593488:0:17181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:3.0:1788592886.593530:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbd314a3362db5efe 00000004:00100000:3.0:1788592886.593544:0:17181:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788592886.593671:0:17181:0:(import.c:65:import_set_state_nolock()) ffff921743beb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592886.593730:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875475226061184:12345-0@lo:38:kworker.0 Request processed in 261us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592886.593738:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592886.599349:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:3641:x1875475226060928:12345-0@lo:400:kworker.0 Request processed in 6097us (12633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592886.599367:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788592886.602106:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226060928:0@lo:400:kworker.0 00010000:00080000:0.0:1788592886.618220:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92186d50b480 x1875475226061184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788592886.618242:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788592886.618250:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788592886.618255:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788592886.618259:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9217439b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788592886.618265:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875475226061184:0@lo:38:kworker.0 00000100:00100000:2.0:1788592886.621917:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226061056:12345-0@lo:38:kworker.0 Request processed in 32574us (32758us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592886.621931:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788592886.627508:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592886.627521:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788592886.627527:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061056:0@lo:38:kworker.0 00010000:00010000:2.0:1788592886.969949:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592887.353025:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00010000:00010000:0.0:1788592887.994306:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592888.378640:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00010000:00010000:2.0:1788592889.016322:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592889.400366:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00010000:00010000:2.0:1788592890.041202:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592890.424136:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00010000:00010000:1.0:1788592891.064226:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592891.448145:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000100:00100000:0.0:1788592891.705034:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592881/real 1788592881] req@ffff921744778700 x1875475226058112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592891.705098:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff921744778700 x1875475226058112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592891.705110:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592881/real 1788592881] req@ffff921744779500 x1875475226057984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592891.705121:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff921744779500 x1875475226057984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788592891.705138:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592891.705160:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788592891.705164:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226058112:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788592891.705170:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218696ac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592891.705174:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788592891.705177:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226057984:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788592891.705297:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788592891.705303:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788592891.705305:0:38:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592891.705311:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:2.0:1788592891.705316:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788592891.705322:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92186f447800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592891.705343:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d509180 x1875475226061440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592891.705356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592891.705359:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788592891.705361:0:38:0:(import.c:65:import_set_state_nolock()) ffff9218696ac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592891.705363:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1788592891.705365:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788592891.705376:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9218696ac800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592891.705389:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d508700 x1875475226061568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592891.705398:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592891.705400:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788592891.705402:0:38:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592891.705405:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1788592891.705408:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788592891.705411:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592891.705421:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d50a300 x1875475226061696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592891.705465:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592891.705476:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226061312:0@lo:400:kworker.0 00000100:00100000:2.0:1788592891.705540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592891.705590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226061824:0@lo:400:kworker.0 00000100:00100000:2.0:1788592891.705617:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592891.705651:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226061312 00000100:00100000:2.0:1788592891.705658:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226061312 00000100:00100000:2.0:1788592891.705715:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592891.705725:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:3641:x1875475226061312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592891.705772:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:3641:x1875475226061312:12345-0@lo:400:kworker.0 Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592891.705779:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592891.705808:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226061824 00000100:00100000:2.0:1788592891.705812:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226061824 00000100:00100000:2.0:1788592891.705838:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592891.705853:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226061824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592891.705888:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226061824:12345-0@lo:400:kworker.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592891.705894:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788592891.706108:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92186d50b100 x1875475226061824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592891.706119:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226061824:0@lo:400:kworker.0 00000100:00100000:2.0:1788592891.706143:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226061312:0@lo:400:kworker.0 00000100:00100000:2.0:1788592891.706158:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061440:0@lo:38:kworker.0 00000100:00100000:2.0:1788592891.706187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592891.706214:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061568:0@lo:8:kworker.0 00000400:00000100:2.0:1788592891.706230:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226061568 offset 0 length 520: 4 00000100:00100000:2.0:1788592891.706241:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061696:0@lo:8:kworker.0 00000400:00000100:2.0:1788592891.706255:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226061696 offset 0 length 520: 4 00000100:00100000:0.0:1788592891.707143:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226061440 00000100:00100000:0.0:1788592891.707152:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226061440 00000100:00100000:0.0:1788592891.707185:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592891.707191:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875475226061440:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788592891.707208:0:17185:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788592891.728628:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875475226061440:12345-0@lo:38:kworker.0 Request processed in 21425us (22428us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788592891.728648:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788592891.728955:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592891.728961:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788592891.728964:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061440:0@lo:38:kworker.0 00010000:00010000:1.0:1788592892.093628:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592892.477256:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000020:01000004:0.0:1788592892.683032:0:17910:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788592892.683042:0:17910:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788592892.683044:0:17910:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788592892.683285:0:17910:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9218758fa000 00000020:01000004:0.0:1788592892.683301:0:17910:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788592892.683312:0:17910:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788592892.683325:0:17910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff92184754cd40) 00000020:00000080:0.0:1788592892.683341:0:17910:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788592892.773214:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788592892.775197:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.776210:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788592892.776479:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788592892.776888:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788592892.777113:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788592892.778062:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788592892.778470:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788592892.778712:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788592892.779124:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788592892.779428:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788592892.779680:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788592892.780164:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788592892.780473:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788592892.781147:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.781457:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.781729:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.782190:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.782533:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.784171:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.784432:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.784614:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.784971:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.785169:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.785411:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.785581:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.785871:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.786105:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.786296:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788592892.786606:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788592892.787021:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.787602:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.788208:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.788448:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.788683:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.789153:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.789372:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.789584:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.789918:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.790266:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.790786:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.792639:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.792892:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788592892.793139:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.793411:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788592892.794004:0:17910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00080000:01000000:2.0:1788592892.798325:0:17910:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788592892.798582:0:17910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788592892.798596:0:17910:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788592892.798608:0:17910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db5f0c 00000020:01000004:2.0:1788592892.798616:0:17910:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788592892.798637:0:17910:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788592892.798641:0:17910:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788592892.798646:0:17910:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788592892.798894:0:17910:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788592892.798900:0:17910:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788592892.812548:0:17910:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788592892.812588:0:17910:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.147@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788592892.812592:0:17910:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788592892.812593:0:17910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788592892.812595:0:17910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592892.812596:0:17910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592892.812597:0:17910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592892.812599:0:17910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592892.812600:0:17910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788592892.812602:0:17910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592892.812603:0:17910:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592892.812607:0:17910:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788592892.812609:0:17910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788592892.812610:0:17910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788592892.812612:0:17910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592892.812613:0:17910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592892.812614:0:17910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592892.812615:0:17910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592892.812616:0:17910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788592892.812617:0:17910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592892.812618:0:17910:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592892.812651:0:17910:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788592892.812736:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226061952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788592892.812799:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.812889:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.816183:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226061952 00000100:00100000:0.0:1788592892.816198:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226061952 00000100:00100000:0.0:1788592892.816417:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592892.816428:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+12:17910:x1875475226061952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788592892.816476:0:17175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788592892.816480:0:17175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788592892.816487:0:17175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788592892.818410:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+12:17910:x1875475226061952:12345-0@lo:253:mount.lustre.0 Request processed in 1978us (5604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.818422:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592892.818644:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226061952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788592892.818660:0:17910:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788592892.818682:0:17910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788592892.818684:0:17910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788592892.818685:0:17910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592892.818687:0:17910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592892.818688:0:17910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592892.818689:0:17910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592892.818690:0:17910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788592892.818693:0:17910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592892.818694:0:17910:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788592892.818712:0:17910:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9218758fa000 from lustre-MDT0001 10000000:01000000:3.0:1788592892.818738:0:17910:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788592892.818741:0:17910:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788592892.818747:0:17910:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92174350b380 local copy 00010000:00010000:3.0:1788592892.818756:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.818847:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.818880:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.818917:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.819166:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062080 00000100:00100000:2.0:1788592892.819173:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062080 00000100:00100000:2.0:1788592892.819207:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592892.819215:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17910:x1875475226062080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592892.819290:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+12:17910:x1875475226062080:12345-0@lo:501:mount.lustre.0 Request processed in 76us (410us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592892.819297:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788592892.819852:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788592892.819866:0:17910:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788592892.819885:0:17910:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788592892.819891:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.819900:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.819924:0:17910:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9218758fa000 10000000:01000000:3.0:1788592892.819928:0:17910:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788592892.819932:0:17910:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92174350b380 10000000:01000000:3.0:1788592892.819955:0:17910:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788592892.819959:0:17910:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92174350b380 from 1 10000000:01000000:3.0:1788592892.819962:0:17910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788592892.819984:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.819992:0:17910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.820001:0:17910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.820014:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592892.820040:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.820064:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.820142:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062208 00000100:00100000:0.0:1788592892.820146:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062208 00000100:00100000:0.0:1788592892.820171:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592892.820177:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+12:17910:x1875475226062208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592892.820186:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592892.820199:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0200/0xbd314a3362db5f1a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5f13 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.820229:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0200/0xbd314a3362db5f1a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5f13 expref: 13 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.820240:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0200/0xbd314a3362db5f1a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5f13 expref: 13 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.820330:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0200, rc 0) 00000100:00100000:0.0:1788592892.820363:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+13:17910:x1875475226062208:12345-0@lo:101:mount.lustre.0 Request processed in 186us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.820369:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788592892.820464:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592892.820475:0:17910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f1a expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.820484:0:17910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5f1a expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.820497:0:17910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788592892.820569:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f1a expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.820577:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205e200/0xbd314a3362db5f13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f1a expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.820584:0:17910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9218758fa000 10000000:01000000:3.0:1788592892.820592:0:17910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788592892.820595:0:17910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9218758fa000 from 1 10000000:01000000:3.0:1788592892.820597:0:17910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788592892.820611:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.820618:0:17910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.820625:0:17910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.820636:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592892.820658:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.820768:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.820834:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062336 00000100:00100000:2.0:1788592892.820838:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062336 00000100:00100000:2.0:1788592892.820896:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592892.820903:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+13:17910:x1875475226062336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592892.820910:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592892.820918:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185820f400/0xbd314a3362db5f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5f21 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.820949:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185820f400/0xbd314a3362db5f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5f21 expref: 14 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.820957:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185820f400/0xbd314a3362db5f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5f21 expref: 14 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.820964:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f400, rc 0) 00000100:00100000:2.0:1788592892.821033:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+14:17910:x1875475226062336:12345-0@lo:101:mount.lustre.0 Request processed in 130us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.821052:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592892.821224:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592892.821235:0:17910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f28 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.821327:0:17910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5f28 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.821342:0:17910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788592892.821384:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f28 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.821391:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205f600/0xbd314a3362db5f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f28 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.821397:0:17910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788592892.821406:0:17910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592892.821412:0:17910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9218758fa000 10000000:01000000:3.0:1788592892.821414:0:17910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788592892.821417:0:17910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788592892.821419:0:17910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788592892.821435:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.821441:0:17910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.821448:0:17910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.821461:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592892.821489:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.821526:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.821634:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062464 00000100:00100000:2.0:1788592892.821639:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062464 00000100:00100000:2.0:1788592892.821678:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592892.821687:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+14:17910:x1875475226062464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592892.821695:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592892.821704:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185820e200/0xbd314a3362db5f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5f2f expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.821720:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185820e200/0xbd314a3362db5f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5f2f expref: 15 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.821728:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185820e200/0xbd314a3362db5f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5f2f expref: 15 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.821735:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820e200, rc 0) 00000100:00100000:2.0:1788592892.821772:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062464:12345-0@lo:101:mount.lustre.0 Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.821778:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592892.821913:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592892.821923:0:17910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f36 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.821930:0:17910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5f36 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592892.823372:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788592892.824223:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592892.829828:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788592892.829891:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788592892.829909:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788592892.829924:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788592892.829964:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788592892.829980:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788592892.829995:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788592892.830010:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788592892.830027:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788592892.830039:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788592892.830050:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788592892.830061:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788592892.830098:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788592892.830114:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788592892.830127:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788592892.830141:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788592892.830158:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788592892.830169:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788592892.830181:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788592892.830192:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788592892.830203:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788592892.830215:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788592892.830230:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788592892.830257:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788592892.830262:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788592892.830371:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.830433:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.830464:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218454c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.830597:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062592 00000100:00100000:2.0:1788592892.830605:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062592 00000100:00100000:2.0:1788592892.830659:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592892.830667:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592892.830814:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062592:12345-0@lo:501:mount.lustre.0 Request processed in 147us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.830822:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788592892.830897:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.830928:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592892.830978:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.830999:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218454c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.831259:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062720 00000100:00100000:2.0:1788592892.831264:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062720 00000100:00100000:2.0:1788592892.831293:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592892.831299:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592892.832003:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062720:12345-0@lo:503:mount.lustre.0 Request processed in 702us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.832011:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788592892.832113:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788592892.832481:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592892.832552:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.832589:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.832620:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff921847274900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.832767:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062848 00000100:00100000:2.0:1788592892.832772:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062848 00000100:00100000:2.0:1788592892.832809:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592892.832816:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592892.833551:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062848:12345-0@lo:502:mount.lustre.0 Request processed in 733us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.833559:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592892.833626:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592892.833811:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788592892.833836:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788592892.833850:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788592892.833862:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788592892.833874:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788592892.833888:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788592892.833900:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788592892.833912:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788592892.833925:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788592892.833947:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788592892.833960:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788592892.833970:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788592892.833981:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788592892.833991:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788592892.834001:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788592892.834012:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788592892.834032:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788592892.834043:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788592892.834053:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788592892.834063:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788592892.834116:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788592892.834127:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788592892.834137:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788592892.834148:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788592892.834158:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788592892.834177:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788592892.834187:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788592892.834197:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788592892.834208:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788592892.834218:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788592892.834228:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788592892.834238:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788592892.834258:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788592892.834270:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788592892.834280:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788592892.834290:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788592892.834300:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788592892.834310:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788592892.834320:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788592892.834331:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788592892.834341:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788592892.834351:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788592892.834362:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788592892.834372:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788592892.834400:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.834439:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.834465:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff921847274900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.834609:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226062976 00000100:00100000:2.0:1788592892.834614:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226062976 00000100:00100000:2.0:1788592892.834652:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788592892.834659:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592892.834744:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226062976:12345-0@lo:502:mount.lustre.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.834758:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592892.834835:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226062976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788592892.834883:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788592892.834892:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788592892.835718:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592892.835729:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592892.835732:0:17914:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788592892.835737:0:17914:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788592892.835740:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592892.835752:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff92186d5999c0) 00000020:00000080:1.0:1788592892.835773:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788592892.835778:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788592892.835872:0:17914:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788592892.835882:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db5f44 00000020:00000080:1.0:1788592892.836106:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788592892.836110:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592892.836114:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592892.836115:0:17914:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788592892.836118:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592892.836121:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592892.836123:0:17914:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788592892.836126:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592892.836133:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff92186d59cd40) 00000020:00000080:1.0:1788592892.836142:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788592892.836145:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788592892.836147:0:17914:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788592892.836149:0:17914:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788592892.836155:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788592892.836205:0:17914:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9218758fa000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788592892.836216:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff92186b9f99c0) 00000020:00000080:1.0:1788592892.836224:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788592892.836272:0:17914:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788592892.836276:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db5f59 00000020:00000080:1.0:1788592892.836358:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788592892.836363:0:17914:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788592892.836366:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbd314a3362db5f60 00080000:01000000:1.0:1788592892.836371:0:17914:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788592892.836374:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db5f67 00010000:00010000:2.0:1788592892.883213:0:17914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788592892.884200:0:17914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788592892.884546:0:17914:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788592892.886201:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788592892.886214:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592892.886221:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.886224:0:17914:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788592892.886228:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592892.886234:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.886235:0:17914:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788592892.886239:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788592892.886244:0:17914:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:00000080:3.0:1788592892.886270:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592892.886293:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff92187d754d40) 00000020:00000080:3.0:1788592892.886316:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788592892.886320:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788592892.886409:0:17914:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788592892.886415:0:17914:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788592892.886423:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db5f75 00010000:00080000:3.0:1788592892.886457:0:17914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9218765f8800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592892.890326:0:17914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788592892.893863:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788592892.893879:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788592892.893919:0:17914:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788592892.893987:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db5f7c 00000100:00080000:3.0:1788592892.893998:0:17914:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592892.894004:0:17914:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9218765f8800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592892.894039:0:17914:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360c700 x1875475226063104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592892.894099:0:17914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788592892.894146:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592892.894149:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.894152:0:17914:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788592892.894155:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788592892.894158:0:17914:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788592892.894159:0:17914:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592892.894161:0:17914:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592892.894162:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788592892.894165:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.894166:0:17914:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788592892.894168:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592892.894172:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.894174:0:17914:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788592892.894177:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788592892.894218:0:17914:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788592892.894231:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592892.894234:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.894235:0:17914:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788592892.894238:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788592892.894239:0:17914:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788592892.894241:0:17914:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592892.894243:0:17914:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592892.894244:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788592892.894246:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.894247:0:17914:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788592892.894250:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788592892.894253:0:17914:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788592892.894256:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592892.894258:0:17914:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788592892.894260:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788592892.894263:0:17914:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:3.0:1788592892.894286:0:17914:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788592892.894289:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592892.894302:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff92187d7519c0) 00000020:00000080:3.0:1788592892.894313:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788592892.894317:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788592892.894378:0:17914:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788592892.894385:0:17914:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788592892.894391:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db5f8a 00010000:00080000:3.0:1788592892.894419:0:17914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9218765fc000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.147@tcp at head 00000100:00080000:1.0:1788592892.894677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788592892.894682:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788592892.894685:0:8:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592892.894690:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:1.0:1788592892.894694:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788592892.894698:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92186f447800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592892.894729:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744554700 x1875475226063232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592892.894749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592892.894753:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788592892.894756:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592892.894760:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592892.894771:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226063104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592892.894807:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475226063360:0@lo:400:kworker.0 00000100:00100000:2.0:1788592892.894856:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592892.894862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.894907:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226063232:0@lo:38:kworker.0 00000100:00100000:2.0:1788592892.894945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592892.894948:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226063360 00000100:00100000:1.0:1788592892.894957:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226063360 00000100:00100000:2.0:1788592892.894984:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226063104 00000100:00100000:2.0:1788592892.894989:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226063104 00000100:00100000:1.0:1788592892.895002:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592892.895009:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226063232 00000100:00100000:2.0:1788592892.895013:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226063232 00000100:00100000:1.0:1788592892.895014:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475226063360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592892.895028:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592892.895034:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226063104:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788592892.895090:0:17184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000100:00100000:1.0:1788592892.895094:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875475226063360:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.895103:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000080:2.0:1788592892.895126:0:17184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db5f91 00000004:00100000:2.0:1788592892.895144:0:17184:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1788592892.895149:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff921744554380 x1875475226063360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00000004:2.0:1788592892.895150:0:17184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788592892.895165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875475226063360:0@lo:400:kworker.0 00010000:00010000:3.0:1788592892.895524:0:17914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1788592892.898313:0:17914:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788592892.899233:0:17914:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788592892.905958:0:17914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788592892.906242:0:17184:0:(import.c:65:import_set_state_nolock()) ffff921842b93000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592892.906462:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788592892.906482:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788592892.906490:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788592892.906496:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788592892.906505:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788592892.906524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226063104:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788592892.906574:0:17914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:1.0:1788592892.906670:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875475226063104:12345-0@lo:38:llog_process_th.0 Request processed in 11634us (11813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.906681:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592892.906708:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592892.906714:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226063232:12345-0@lo:38:kworker.0 00000040:00080000:2.0:1788592892.906725:0:17914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1788592892.906762:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226063232:12345-0@lo:38:kworker.0 Request processed in 47us (11826us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788592892.906774:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592892.906800:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592892.906805:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592892.906809:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788592892.906812:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226063232:0@lo:38:kworker.0 00000100:00100000:0.0:1788592892.906882:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592892.906897:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226063488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592892.907004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592892.907042:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226063488 00000100:00100000:0.0:1788592892.907048:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226063488 00000100:00100000:0.0:1788592892.907114:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592892.907120:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875475226063488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592892.907143:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1788592892.907177:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875475226063488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.907183:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592892.907212:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226063488:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788592892.911048:0:17919:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788592892.911056:0:17919:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788592892.913994:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788592892.914008:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788592892.914052:0:17914:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788592892.914784:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db5f98 00000100:00080000:2.0:1788592892.914798:0:17914:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592892.914813:0:17914:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9218765fc000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592892.914857:0:17914:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d509500 x1875475226063616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592892.914883:0:17914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788592892.915131:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592892.915135:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.915138:0:17914:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788592892.915141:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788592892.915144:0:17914:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788592892.915145:0:17914:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788592892.915147:0:17914:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788592892.915149:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788592892.915151:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.915153:0:17914:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788592892.915155:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592892.915160:0:17914:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788592892.915163:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.915165:0:17914:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788592892.915168:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592892.915171:0:17914:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.147@tcp to nid 0x20000c0a8cb93 (192.168.203.147@tcp) 00000020:01000000:2.0:1788592892.915194:0:17914:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788592892.915197:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592892.915209:0:17914:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff92187d78b380) 00000020:00000080:2.0:1788592892.915225:0:17914:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788592892.915230:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592892.915296:0:17914:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788592892.915304:0:17914:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788592892.915309:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd314a3362db5fa6 00010000:00080000:2.0:1788592892.915338:0:17914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921875a98800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592892.915596:0:17914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788592892.915666:0:17914:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788592892.915689:0:17914:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788592892.915895:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226063616:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788592892.915960:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226063616 offset 0 length 520: 4 00000040:00080000:2.0:1788592892.917747:0:17914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592892.918048:0:17914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788592892.918324:0:17914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:3.0:1788592892.918664:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592892.918669:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592892.918672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592892.918675:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788592892.918863:0:17921:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788592892.918867:0:17921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788592892.919898:0:17914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788592892.919912:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788592892.919966:0:17914:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788592892.919992:0:17914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db5fad 00000100:00080000:2.0:1788592892.920003:0:17914:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592892.920009:0:17914:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff921875a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592892.920044:0:17914:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186d50b800 x1875475226063744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592892.920124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226063744:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788592892.920182:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226063744 offset 0 length 520: 4 00000100:00080000:2.0:1788592892.920253:0:17914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788592892.920306:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592892.920310:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.920312:0:17914:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788592892.920315:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592892.920318:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.920319:0:17914:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788592892.920322:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788592892.920323:0:17914:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788592892.920325:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592892.920328:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.920329:0:17914:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788592892.920331:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592892.920333:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.920335:0:17914:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788592892.920338:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788592892.920366:0:17914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592892.920369:0:17914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592892.920370:0:17914:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788592892.920373:0:17914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788592892.920435:0:17910:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788592892.920465:0:17910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788592892.920480:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f36 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920491:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205ec00/0xbd314a3362db5f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5f36 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592892.920498:0:17910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9218758fa000 from 1 10000000:01000000:2.0:1788592892.920512:0:17910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592892.920537:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920545:0:17910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920556:0:17910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592892.920571:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226063872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592892.920610:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.920630:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.920653:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226063872 00000100:00100000:2.0:1788592892.920659:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226063872 00000100:00100000:2.0:1788592892.920698:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788592892.920711:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+15:17910:x1875475226063872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592892.920723:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592892.920735:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5fb4 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920768:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 16 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920778:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 16 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920786:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185820f600, rc 0) 00000100:00100000:2.0:1788592892.920826:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+16:17910:x1875475226063872:12345-0@lo:101:mount.lustre.0 Request processed in 119us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.920832:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788592892.920889:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226063872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592892.920901:0:17910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.920909:0:17910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788592892.921448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592892.921453:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592892.921454:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064000:0@lo:256:mount.lustre.0 00000100:00080000:3.0:1788592892.921456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592892.921459:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592892.921491:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.921525:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592892.921765:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064000 00000100:00100000:1.0:1788592892.921771:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064000 00000100:00100000:1.0:1788592892.921806:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592892.921813:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+16:17910:x1875475226064000:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788592892.921850:0:17174:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788592892.921865:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788592892.921868:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788592892.921965:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+16:17910:x1875475226064000:12345-0@lo:256:mount.lustre.0 Request processed in 151us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.921972:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592892.922103:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788592892.922682:0:17910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788592892.922704:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.922714:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.922722:0:17910:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218758fa000 from 1 10000000:01000000:3.0:1788592892.922724:0:17910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592892.922761:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.922769:0:17910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.922782:0:17910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.922799:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592892.922837:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.923056:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.923128:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064128 00000100:00100000:0.0:1788592892.923134:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064128 00000100:00100000:0.0:1788592892.923200:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592892.923207:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+16:17910:x1875475226064128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592892.923217:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592892.923229:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5fc2 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.923248:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.923257:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.923264:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0e00, rc 0) 00000100:00100000:0.0:1788592892.923295:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064128:12345-0@lo:101:mount.lustre.0 Request processed in 89us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.923302:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788592892.923386:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592892.923400:0:17910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.923408:0:17910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592892.923533:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592892.923562:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.923594:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.923783:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432acc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.923868:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064256 00000100:00100000:2.0:1788592892.923874:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064256 00000100:00100000:2.0:1788592892.923898:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592892.923904:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592892.924000:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064256:12345-0@lo:501:mount.lustre.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.924017:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592892.924155:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.924180:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592892.924217:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.924240:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.924296:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064384 00000100:00100000:0.0:1788592892.924300:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064384 00000100:00100000:0.0:1788592892.924321:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788592892.924326:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592892.924409:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064384:12345-0@lo:503:mount.lustre.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.924415:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788592892.924493:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788592892.924827:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592892.924916:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.924969:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.924993:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.925174:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064512 00000100:00100000:0.0:1788592892.925179:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064512 00000100:00100000:0.0:1788592892.925202:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592892.925208:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592892.925287:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064512:12345-0@lo:502:mount.lustre.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.925293:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592892.925439:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592892.925618:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788592892.925645:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788592892.925659:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788592892.925672:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788592892.925685:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788592892.925696:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788592892.925709:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788592892.925722:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788592892.925734:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788592892.925747:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788592892.925759:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788592892.925779:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.925816:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.925858:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.926004:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064640 00000100:00100000:0.0:1788592892.926009:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064640 00000100:00100000:0.0:1788592892.926045:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788592892.926051:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592892.926195:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064640:12345-0@lo:502:mount.lustre.0 Request processed in 142us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.926202:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592892.926341:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592892.926386:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788592892.926395:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788592892.927258:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592892.927268:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927271:0:17923:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592892.927277:0:17923:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9218758fa000 00000020:00000080:0.0:1788592892.927280:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592892.927287:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592892.927289:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927290:0:17923:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788592892.927293:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592892.927295:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927296:0:17923:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592892.927300:0:17923:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9218758fa000 00000020:00000080:0.0:1788592892.927302:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592892.927357:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592892.927361:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927363:0:17923:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788592892.927365:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592892.927368:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927370:0:17923:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592892.927373:0:17923:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9218758fa000 00000020:00000080:0.0:1788592892.927381:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592892.927398:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592892.927401:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927403:0:17923:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592892.927405:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592892.927407:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927409:0:17923:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788592892.927412:0:17923:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9218758fa000 00000020:00000080:0.0:1788592892.927413:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592892.927434:0:17923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592892.927437:0:17923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592892.927438:0:17923:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788592892.927441:0:17923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788592892.927568:0:17910:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788592892.927592:0:17910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592892.927614:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.927624:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592892.927666:0:17910:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788592892.927674:0:17910:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9218758fa000 10000000:01000000:3.0:1788592892.927677:0:17910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9218758fa000 10000000:01000000:3.0:1788592892.927681:0:17910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592892.927686:0:17910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9218758fa000 from 1 10000000:01000000:3.0:1788592892.927688:0:17910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788592892.927718:0:17910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.927725:0:17910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.927735:0:17910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.927755:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592892.927805:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.927831:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.928957:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064768 00000100:00100000:0.0:1788592892.928966:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064768 00000100:00100000:0.0:1788592892.929017:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592892.929026:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17910:x1875475226064768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592892.929038:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592892.929056:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f1c00/0xbd314a3362db5fd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5fd0 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.929097:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f1c00/0xbd314a3362db5fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5fd0 expref: 18 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.929107:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f1c00/0xbd314a3362db5fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5fd0 expref: 18 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.929115:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1c00, rc 0) 00000100:00100000:0.0:1788592892.929173:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226064768:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.929179:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592892.929301:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592892.929317:0:17910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fd7 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.929325:0:17910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db5fd7 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592892.935361:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788592892.935658:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592892.935853:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788592892.935878:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788592892.935892:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788592892.935904:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788592892.935926:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788592892.935952:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788592892.935967:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788592892.935981:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788592892.935994:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788592892.936007:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788592892.936022:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788592892.936034:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788592892.936047:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788592892.936101:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788592892.936117:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788592892.936131:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788592892.936144:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788592892.936156:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788592892.936169:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788592892.936180:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788592892.936193:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788592892.936207:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788592892.936220:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788592892.936232:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788592892.936244:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788592892.936255:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788592892.936267:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788592892.936280:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788592892.936299:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788592892.936305:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788592892.936377:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.936441:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.936482:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592892.936593:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226064896 00000100:00100000:1.0:1788592892.936601:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226064896 00000100:00100000:1.0:1788592892.936646:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592892.936655:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226064896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592892.936759:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226064896:12345-0@lo:501:mount.lustre.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.936777:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592892.938769:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226064896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592892.938822:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592892.939377:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.939424:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592892.939487:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065024 00000100:00100000:1.0:1788592892.939493:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065024 00000100:00100000:1.0:1788592892.939541:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788592892.939550:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592892.939656:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065024:12345-0@lo:503:mount.lustre.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.939663:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592892.939751:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788592892.940198:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592892.940273:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.940324:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.940350:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065152 00000100:00100000:3.0:1788592892.940354:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065152 00000100:00100000:3.0:1788592892.940379:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788592892.940386:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.940459:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065152:12345-0@lo:502:mount.lustre.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592892.940465:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788592892.940502:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592892.940514:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592892.940667:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788592892.940691:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788592892.940703:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788592892.940717:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788592892.940729:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788592892.940741:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788592892.940754:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788592892.940768:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788592892.940782:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788592892.940794:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788592892.940807:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788592892.940821:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788592892.940833:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788592892.940854:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788592892.940878:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788592892.940893:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788592892.940905:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788592892.940917:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788592892.940929:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788592892.940957:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788592892.940970:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788592892.940983:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788592892.940996:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788592892.941007:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788592892.941020:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788592892.941031:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788592892.941043:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788592892.941054:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788592892.941087:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788592892.941105:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788592892.941132:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788592892.941147:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788592892.941161:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788592892.941175:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788592892.941188:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788592892.941201:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788592892.941215:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788592892.941228:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788592892.941240:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788592892.941251:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788592892.941265:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788592892.941279:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788592892.941292:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788592892.941306:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788592892.941319:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788592892.941333:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788592892.941366:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788592892.941381:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788592892.941418:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.941465:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.941497:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065280 00000100:00100000:3.0:1788592892.941501:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065280 00000100:00100000:3.0:1788592892.941532:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592892.941539:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.942239:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065280:12345-0@lo:502:mount.lustre.0 Request processed in 698us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592892.942247:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592892.942301:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592892.942320:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592892.942480:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788592892.945671:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788592892.945776:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592892.945854:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.945910:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592892.945989:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065408 00000100:00100000:0.0:1788592892.945997:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065408 00000100:00100000:0.0:1788592892.946052:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788592892.946061:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592892.946694:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065408:12345-0@lo:502:mount.lustre.0 Request processed in 632us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.946703:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592892.949634:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592892.949742:0:17910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788592892.949757:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788592892.950962:0:17928:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788592892.950978:0:17928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff92187d753380) 00000020:00000080:3.0:1788592892.951000:0:17928:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788592892.951388:0:17928:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9218758fa000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788592892.951393:0:17928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9218758fa000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788592892.951396:0:17928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9218758fa000 3 00010000:00080000:3.0:1788592892.951429:0:17928:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92174243c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.147@tcp at head 00010000:00010000:3.0:1788592892.953011:0:17928:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788592892.953224:0:17928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788592892.953260:0:17928:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788592892.953273:0:17928:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbd314a3362db5fe5 00000100:00080000:3.0:1788592892.953284:0:17928:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592892.953290:0:17928:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92174243c800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592892.953322:0:17928:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360c700 x1875475226065536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592892.953342:0:17928:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788592892.953373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592892.953378:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592892.953381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592892.953383:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788592892.953475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475226065536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592892.953542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.953828:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065536 00000100:00100000:3.0:1788592892.953836:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065536 00000100:00100000:3.0:1788592892.953902:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592892.953909:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1875475226065536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788592892.953957:0:17181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:3.0:1788592892.953988:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbd314a3362db5fec 00000004:00100000:3.0:1788592892.954004:0:17181:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788592892.954033:0:17181:0:(import.c:65:import_set_state_nolock()) ffff9218765fc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592892.954110:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875475226065536:12345-0@lo:38:llog_process_th.0 Request processed in 199us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592892.954118:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788592892.954202:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92174360c700 x1875475226065536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592892.954212:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592892.954220:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788592892.954227:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788592892.954230:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788592892.954232:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92174243c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788592892.954237:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875475226065536:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788592892.958355:0:17928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1788592892.958424:0:17910:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788592892.958451:0:17910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592892.958468:0:17910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fd7 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.958481:0:17910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205f800/0xbd314a3362db5fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5fd7 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592892.958637:0:17910:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592892.958639:0:17910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592892.958641:0:17910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592892.958642:0:17910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592892.958643:0:17910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592892.958644:0:17910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592892.958645:0:17910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592892.958647:0:17910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592892.958648:0:17910:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592892.958651:0:17910:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788592892.958654:0:17910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592892.958655:0:17910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788592892.958656:0:17910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592892.958657:0:17910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592892.958658:0:17910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592892.958659:0:17910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592892.958660:0:17910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592892.958661:0:17910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592892.958662:0:17910:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592892.958692:0:17910:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788592892.958712:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788592892.958778:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592892.960685:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741d22b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592892.961756:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065664 00000100:00100000:3.0:1788592892.961767:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065664 00000100:00100000:3.0:1788592892.961826:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788592892.961837:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788592892.961877:0:17172:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788592892.961890:0:17172:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788592892.966697:0:17160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788592892.967213:0:17172:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788592892.967254:0:17172:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788592892.967265:0:17195:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592892.967269:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592892.967289:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967306:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967313:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 18 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967320:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967359:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 18 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967432:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 18 pid: 17175 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.967447:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226065792:0@lo:104: 00000100:00100000:3.0:1788592892.967496:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592892.967544:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967567:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 18 pid: 17174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592892.967576:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226065920:0@lo:104: 00000100:00100000:2.0:1788592892.967579:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065792 00000100:00100000:2.0:1788592892.967585:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065792 00000100:00100000:3.0:1788592892.967597:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592892.967612:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218432ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592892.967618:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226065920 00000100:00100000:2.0:1788592892.967621:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226065920 00000100:00100000:3.0:1788592892.967630:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592892.967638:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:17195:x1875475226065792:12345-0@lo:104: 00010000:00010000:3.0:1788592892.967654:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967695:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592892.967698:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:17910:x1875475226065664:12345-0@lo:253:mount.lustre.0 Request processed in 5863us (8920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592892.967700:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:17195:x1875475226065792:12345-0@lo:104: Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.967707:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788592892.967765:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:17910:1875475226065664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788592892.967777:0:17910:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788592892.967780:0:17910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788592892.967782:0:17910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788592892.967783:0:17910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592892.967784:0:17910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592892.967792:0:17910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592892.967793:0:17910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592892.967794:0:17910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592892.967796:0:17910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592892.967798:0:17910:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788592892.967813:0:17910:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788592892.967817:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592892.967834:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592892.967889:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226065920:12345-0@lo:104: 00010000:00010000:3.0:1788592892.967898:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592892.967944:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592892.967949:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226065920:12345-0@lo:104: Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592892.967954:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592892.967978:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226065792:0@lo:104: 00000100:00100000:3.0:1788592892.968091:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226065920:0@lo:104: 00010000:00010000:3.0:1788592892.968111:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968813:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592892.968822:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968830:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f800 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592892.968833:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968841:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592892.968848:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592892.968853:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592892.968886:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968891:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592892.968921:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968928:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185820f800/0xbd314a3362db5fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5fbb expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968961:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592892.968964:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968968:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592892.968971:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.968977:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592892.968984:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592892.968989:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592892.969004:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969008:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592892.969025:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969031:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db5ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5ef7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969043:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592892.969044:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592892.969045:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592892.969054:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592892.969103:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226066048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592892.969145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.969186:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226066176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592892.969208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.969263:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066048 00000100:00100000:2.0:1788592892.969268:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066048 00010000:00010000:2.0:1788592892.969289:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 18 pid: 17175 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592892.969310:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066176 00000100:00100000:2.0:1788592892.969313:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066176 00010000:00010000:2.0:1788592892.969324:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 19 pid: 17174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592892.969337:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592892.969342:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70647b28-81c8-4371-870a-35a99a7dd483+19:3641:x1875475226066048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592892.969353:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592892.969358:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 19 pid: 17175 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969369:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 19 pid: 17175 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969382:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185820f600/0xbd314a3362db5fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db5fb4 expref: 19 pid: 17175 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969392:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592892.969419:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70647b28-81c8-4371-870a-35a99a7dd483+18:3641:x1875475226066048:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.969424:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592892.969443:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592892.969448:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70647b28-81c8-4371-870a-35a99a7dd483+17:3639:x1875475226066176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592892.969456:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592892.969460:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 17 pid: 17174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969467:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 17 pid: 17174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969475:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185820ee00/0xbd314a3362db5ef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db5ef0 expref: 17 pid: 17174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969485:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969492:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592892.969505:0:17166:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003895772s 00010000:00010000:2.0:1788592892.969509:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969515:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969521:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969527:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969531:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592892.969541:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969548:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969561:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969571:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592892.969596:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70647b28-81c8-4371-870a-35a99a7dd483+16:3639:x1875475226066176:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592892.969601:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592892.969635:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226066176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592892.969654:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226066048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592892.969667:0:17195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969674:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592892.969679:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205f200/0xbd314a3362db5ff3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592892.970663:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788592892.977451:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788592892.977533:0:17934:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788592892.977537:0:17934:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788592892.977792:0:17935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788592892.978024:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788592892.978289:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592892.979968:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17936:1875475226066304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788592892.980189:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788592892.980222:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592892.980384:0:17935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788592892.980438:0:17935:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1788592892.981529:0:17910:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788592892.981543:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788592892.981612:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592892.982807:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788592892.983464:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788592892.983498:0:17910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788592892.983596:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592892.984186:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.984222:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671780 going to sleep for 11 seconds 00080000:10000000:1.0:1788592892.984435:0:17910:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1788592892.984767:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066304 00000100:00100000:0.0:1788592892.984775:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066304 00000100:00100000:0.0:1788592892.984868:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592892.984877:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17936:x1875475226066304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788592892.984978:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17936:x1875475226066304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 102us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592892.984984:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592892.985127:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17936:1875475226066304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788592892.985170:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788592892.985208:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17936:1875475226066432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788592892.985245:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.985446:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592892.985485:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066432 00000100:00100000:3.0:1788592892.985491:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066432 00000100:00100000:3.0:1788592892.985515:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592892.985521:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17936:x1875475226066432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788592892.985628:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17936:x1875475226066432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592892.985634:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592892.985698:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17936:1875475226066432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788592892.985749:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17936:1875475226066560:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788592892.985778:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.985834:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592892.986172:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066560 00000100:00100000:1.0:1788592892.986177:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066560 00000100:00100000:1.0:1788592892.986254:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592892.986260:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1875475226066560:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788592892.986305:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1875475226066560:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.986311:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788592892.986416:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92186d50bb80 x1875475226066560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788592908 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592892.986426:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17936:1875475226066560:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788592892.986467:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17936:1875475226066688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788592892.986492:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592892.986517:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592892.986557:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066688 00000100:00100000:1.0:1788592892.986562:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066688 00000100:00100000:1.0:1788592892.986579:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592892.986584:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17936:x1875475226066688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788592892.986642:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17936:x1875475226066688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 57us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592892.986661:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592892.987325:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17936:1875475226066688:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788592892.987368:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592892.989516:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788592892.989593:0:17936:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788592892.989599:0:17936:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1788592892.990230:0:17910:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788592892.991961:0:17910:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788592892.991991:0:17910:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb76c81c5b988 00100000:10000000:3.0:1788592892.992000:0:17910:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788592892.992996:0:17910:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788592892.993027:0:17910:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788592892.993042:0:17910:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788592892.993056:0:17910:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788592893.000764:0:17910:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592893.000993:0:17910:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788592893.113198:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788592893.496725:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788592893.497750:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000040:00080000:1.0:1788592894.008739:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788592894.137297:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592894.521277:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 10000000:01000000:0.0:1788592894.904143:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788592894.904150:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9218758fa000 from 8 10000000:01000000:0.0:1788592894.904155:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788592894.904206:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592894.904227:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592894.904239:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592894.904263:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226066816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592894.904335:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592894.904383:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921845024000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592894.904542:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066816 00000100:00100000:1.0:1788592894.904550:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066816 00000100:00100000:1.0:1788592894.904602:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788592894.904611:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+16:17177:x1875475226066816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592894.904623:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592894.904637:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db5ffa expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592894.904660:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592894.904671:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 17 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592894.904679:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022aa00, rc 0) 00000100:00100000:1.0:1788592894.904730:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226066816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592894.904749:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592894.904793:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226066816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592894.904809:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592894.904828:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592894.904876:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226066944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788592894.904907:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592894.904940:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218517bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592894.904992:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226066944 00000100:00100000:0.0:1788592894.904997:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226066944 00000100:00100000:0.0:1788592894.905027:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592894.905033:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226066944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788592894.905046:0:17174:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592894.905061:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592894.905064:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788592894.905152:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226066944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592894.905159:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788592894.905234:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226066944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788592894.905273:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592894.905279:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592894.905287:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592894.905295:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788592894.905297:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92174444b000 from 8 10000000:01000000:2.0:1788592894.905299:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592894.905315:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592894.905321:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592894.905328:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592894.905339:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226067072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592894.905369:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592894.905393:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218517bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592894.905448:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067072 00000100:00100000:0.0:1788592894.905452:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067072 00000100:00100000:0.0:1788592894.905479:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788592894.905485:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226067072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592894.905492:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592894.905500:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6008 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592894.905525:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6008 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592894.905533:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6008 expref: 18 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592894.905541:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0600, rc 0) 00000100:00100000:0.0:1788592894.905567:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226067072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592894.905573:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788592894.905798:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226067072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592894.905810:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592894.905818:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592894.905854:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226067200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788592894.905881:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592894.905902:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218517bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592894.906313:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067200 00000100:00100000:0.0:1788592894.906318:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067200 00000100:00100000:0.0:1788592894.906368:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592894.906375:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226067200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788592894.906387:0:17174:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592894.906399:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592894.906402:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788592894.906478:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226067200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592894.906485:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788592894.906669:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226067200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788592894.906708:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592894.906716:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592894.906722:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592895.032759:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788592895.161023:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592895.544777:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00010000:00010000:3.0:1788592896.184248:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592896.568139:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000001:02000400:1.0:1788592896.966799:0:18179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788592897.208350:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592897.593109:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 0 seconds 00000020:00000004:1.0:1788592897.760037:0:18231:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592897.760457:0:18231:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788592898.245512:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592898.360367:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226067328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592898.360440:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592898.360554:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067328 00000100:00100000:3.0:1788592898.360562:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067328 00000100:00100000:3.0:1788592898.360612:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788592898.360623:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226067328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592898.360653:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788592898.360706:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226067328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592898.360738:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592898.360964:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226067328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592898.361304:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788592898.361349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788592898.361354:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788592898.361357:0:8:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592898.361365:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92186f447800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592898.361387:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360c000 x1875475226067584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592898.361413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592898.361417:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592898.361420:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592898.361423:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788592898.361474:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226067584:0@lo:38:kworker.0 00000100:00100000:1.0:1788592898.361517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592898.361589:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067584 00000100:00100000:2.0:1788592898.361594:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067584 00000100:00100000:2.0:1788592898.361625:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592898.361638:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1875475226067584:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788592898.361660:0:17184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1788592898.361693:0:17184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db6016 00000004:00100000:2.0:1788592898.361706:0:17184:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788592898.361712:0:17184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788592898.362867:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226067712:0@lo:400:kworker.0 00000100:00100000:0.0:1788592898.362929:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592898.362995:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226067456:0@lo:400:kworker.0 00000100:00100000:0.0:1788592898.363048:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592898.363152:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067456 00000100:00100000:2.0:1788592898.363158:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067456 00000100:00100000:2.0:1788592898.363203:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592898.363211:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:3642:x1875475226067456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592898.363256:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:3642:x1875475226067456:12345-0@lo:400:kworker.0 Request processed in 45us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592898.363263:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592898.363404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226067456:0@lo:400:kworker.0 00000100:00080000:3.0:1788592898.363491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592898.363496:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592898.363498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592898.363501:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788592898.363546:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226067840:0@lo:400:kworker.0 00000100:00100000:3.0:1788592898.363578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592898.363933:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067712 00000100:00100000:1.0:1788592898.363939:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067712 00000100:00100000:1.0:1788592898.363975:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067840 00000100:00100000:1.0:1788592898.363978:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067840 00000100:00100000:1.0:1788592898.363990:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592898.363997:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226067712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592898.364119:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226067712:12345-0@lo:400:kworker.0 Request processed in 122us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592898.364126:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592898.364141:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592898.364148:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226067840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592898.364178:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226067840:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592898.364184:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788592898.364316:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92174360ce00 x1875475226067840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592898.364329:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226067840:0@lo:400:kworker.0 00010000:00080000:2.0:1788592898.364974:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92174360c380 x1875475226067712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592898.364985:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226067712:0@lo:400:kworker.0 00000100:00080000:0.0:1788592898.366543:0:17184:0:(import.c:65:import_set_state_nolock()) ffff92186f49f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592898.366624:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875475226067584:12345-0@lo:38:kworker.0 Request processed in 4984us (5104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592898.366635:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788592898.366719:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788592898.366729:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788592898.366735:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788592898.366738:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92186f447800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788592898.366760:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007dd3b042): req@ffff92186d508e00 x1875475226060544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592898.366783:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226067584:0@lo:38:kworker.0 00000100:00100000:1.0:1788592898.366863:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592898.366878:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226067968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592898.366979:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592898.367011:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218430c3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592898.367141:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226060544 00000100:00100000:2.0:1788592898.367147:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226060544 00000100:00100000:2.0:1788592898.367182:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592898.367189:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17221:x1875475226060544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788592898.367263:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17221:x1875475226060544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592898.367271:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592898.367342:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1875475226060544:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788592898.367388:0:17221:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788592898.367421:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1875475226068096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788592898.367451:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592898.367484:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592898.367555:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068096 00000100:00100000:0.0:1788592898.367559:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068096 00000100:00100000:0.0:1788592898.367578:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592898.367583:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17221:x1875475226068096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788592898.367664:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17221:x1875475226068096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592898.367671:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592898.367743:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1875475226068096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788592898.367799:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592898.367811:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1875475226068224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788592898.367840:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592898.367851:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742781a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592898.367964:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226067968 00000100:00100000:0.0:1788592898.367968:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226067968 00000100:00100000:0.0:1788592898.367984:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068224 00000100:00100000:0.0:1788592898.367987:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068224 00000100:00100000:0.0:1788592898.367999:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592898.368005:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1875475226067968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788592898.368026:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788592898.368100:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1875475226067968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592898.368108:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592898.368127:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592898.368128:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226067968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592898.368134:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17221:x1875475226068224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788592898.368185:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17221:x1875475226068224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592898.368191:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592898.368293:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17221:1875475226068224:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788592898.368329:0:17221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592898.372343:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788592898.372429:0:17221:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:3.0:1788592898.372435:0:17221:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788592898.564287:0:18282:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592898.564552:0:18282:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788592899.256174:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592899.387474:0:18330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda4bc7f60 20000000:00000080:1.0:1788592899.387492:0:18330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff921876f4d400 uarg=0000000000000000 20000000:01000000:1.0:1788592899.387529:0:18330:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788592899.387537:0:18330:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788592899.387540:0:18330:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788592899.388050:0:18331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788592899.388317:0:18330:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788592899.395396:0:18330:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788592899.395428:0:18330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.395449:0:18330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.395457:0:18330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.395476:0:18330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.395524:0:18330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.395551:0:18330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 17 pid: 17172 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592899.395567:0:18330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18330:1875475226068352:0@lo:104: 00000100:00100000:3.0:1788592899.395631:0:18330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592899.395691:0:18330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 17 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592899.395840:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068352 00000100:00100000:0.0:1788592899.395848:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068352 00010000:00010000:3.0:1788592899.395939:0:18330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 17 pid: 17174 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592899.395953:0:18330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18330:1875475226068480:0@lo:104: 00000100:00100000:3.0:1788592899.395981:0:18330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592899.396104:0:18330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217427816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592899.398124:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068480 00000100:00100000:0.0:1788592899.398137:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068480 00000100:00100000:0.0:1788592899.398200:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592899.398211:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:18330:x1875475226068352:12345-0@lo:104: 00010000:00010000:0.0:1788592899.398227:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398317:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592899.398323:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:18330:x1875475226068352:12345-0@lo:104: Request processed in 116us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592899.398331:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592899.398349:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592899.398355:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:18330:x1875475226068480:12345-0@lo:104: 00010000:00010000:0.0:1788592899.398370:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398406:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788592899.398411:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:18330:x1875475226068480:12345-0@lo:104: Request processed in 57us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592899.398416:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788592899.398435:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592899.398441:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398471:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592899.398475:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398484:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592899.398492:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592899.398498:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592899.398534:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398540:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592899.398559:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398566:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db5fc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5fc9 expref: -99 pid: 17910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398577:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592899.398580:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398586:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f000 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592899.398588:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398606:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592899.398613:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592899.398618:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592899.398633:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398639:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592899.398646:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398652:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185820f000/0xbd314a3362db5ebf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db5ec6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.398664:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592899.398666:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592899.398667:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592899.398943:0:18330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18330:1875475226068352:0@lo:104: 00000100:00100000:3.0:1788592899.398952:0:18330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18330:1875475226068480:0@lo:104: 00010000:00010000:3.0:1788592899.398977:0:18330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592899.399193:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226068608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592899.399238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592899.399281:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592899.399287:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226068736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592899.399307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592899.399419:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068608 00000100:00100000:0.0:1788592899.399424:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068608 00010000:00010000:0.0:1788592899.399448:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 18 pid: 17172 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592899.399483:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068736 00000100:00100000:0.0:1788592899.399486:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068736 00010000:00010000:0.0:1788592899.399499:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 19 pid: 17174 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592899.399512:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592899.399527:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70647b28-81c8-4371-870a-35a99a7dd483+19:3641:x1875475226068608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592899.399539:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592899.399545:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 19 pid: 17172 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399555:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 19 pid: 17172 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399569:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f0e00/0xbd314a3362db5fc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db5fc2 expref: 19 pid: 17172 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399581:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592899.399617:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70647b28-81c8-4371-870a-35a99a7dd483+18:3641:x1875475226068608:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592899.399623:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592899.399639:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592899.399645:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70647b28-81c8-4371-870a-35a99a7dd483+17:3641:x1875475226068736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592899.399653:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592899.399657:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 17 pid: 17174 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399666:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 17 pid: 17174 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399676:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185820e800/0xbd314a3362db5ec6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db5ebf expref: 17 pid: 17174 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399687:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399862:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399877:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399884:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399901:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399908:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399913:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205ee00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592899.399917:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399925:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399947:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592899.399957:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592899.399984:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70647b28-81c8-4371-870a-35a99a7dd483+16:3641:x1875475226068736:12345-0@lo:103:ldlm_bl.0 Request processed in 339us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592899.399990:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592899.400020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226068736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592899.400038:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226068608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592899.400102:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592899.400160:0:18330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.400180:0:18330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592899.400187:0:18330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205ee00/0xbd314a3362db601d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592900.287979:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788592901.308035:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592901.308041:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218758fa000 from 13 10000000:01000000:1.0:1788592901.308045:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592901.308101:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.308113:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.308124:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592901.308151:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226068864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.308224:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592901.308266:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592901.308290:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068864 00000100:00100000:1.0:1788592901.308297:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068864 00000100:00100000:1.0:1788592901.308348:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788592901.308358:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+16:17177:x1875475226068864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592901.308371:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592901.308385:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6024 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.308418:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6024 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.308428:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6024 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.308436:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b600, rc 0) 00000100:00100000:1.0:1788592901.308483:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226068864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592901.308490:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788592901.308540:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226068864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592901.308555:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.308564:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592901.308621:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226068992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.308652:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592901.308670:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592901.308686:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226068992 00000100:00100000:1.0:1788592901.308689:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226068992 00000100:00100000:1.0:1788592901.308717:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788592901.308726:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226068992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.308830:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226068992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592901.308848:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788592901.308898:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226068992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.308932:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.308970:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592901.308983:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592901.308996:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069120 00000100:00100000:1.0:1788592901.309000:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069120 00000100:00100000:1.0:1788592901.309021:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788592901.309027:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226069120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.309125:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226069120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592901.309132:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788592901.309177:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788592901.309824:0:18443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788592901.309887:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788592901.309903:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592901.309910:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.309920:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592901.309928:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592901.309930:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174444b000 from 13 10000000:01000000:1.0:1788592901.309933:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592901.309956:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.309970:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.309979:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592901.309995:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.310029:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592901.310053:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592901.310088:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069248 00000100:00100000:1.0:1788592901.310092:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069248 00000100:00100000:1.0:1788592901.310120:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592901.310126:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92185b018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+17:17177:x1875475226069248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592901.310135:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592901.310143:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6032 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.310162:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6032 expref: 18 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.310170:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6032 expref: 18 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.310177:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a200, rc 0) 00000100:00100000:1.0:1788592901.310205:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92185b018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226069248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592901.310211:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592901.310252:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592901.310264:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.310273:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592901.310309:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.310332:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592901.310345:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592901.310357:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069376 00000100:00100000:1.0:1788592901.310360:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069376 00000100:00100000:1.0:1788592901.310379:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592901.310385:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92185b018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226069376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.310460:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92185b018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226069376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592901.310467:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592901.310494:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.310517:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.310549:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592901.310562:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592901.310573:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069504 00000100:00100000:1.0:1788592901.310576:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069504 00000100:00100000:1.0:1788592901.310595:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592901.310600:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92185b018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226069504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592901.310669:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92185b018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+18:17177:x1875475226069504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592901.310681:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592901.310716:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226069504:0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1788592901.310999:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592901.311694:0:18444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788592901.311824:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788592901.311852:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592901.311860:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592901.311870:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592902.328633:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592902.459657:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592892/real 1788592892] req@ffff92186d50b800 x1875475226063744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592902.459690:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92186d50b800 x1875475226063744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592902.459700:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592892/real 1788592892] req@ffff92186d509500 x1875475226063616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592902.459711:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92186d509500 x1875475226063616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592902.459731:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592902.459750:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788592902.459755:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226063744:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788592902.459761:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fc000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592902.459766:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788592902.459769:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226063616:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788592902.461508:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592902.461522:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592902.461525:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592902.461528:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592902.461558:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592902.461561:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788592902.461564:0:38:0:(import.c:65:import_set_state_nolock()) ffff9218765fc000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592902.461571:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 427 00000100:00080000:2.0:1788592902.461576:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788592902.461584:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9218765fc000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592902.461615:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744774e00 x1875475226070144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592902.461629:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592902.461632:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788592902.461634:0:38:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592902.461637:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 427 00000100:00080000:2.0:1788592902.461640:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788592902.461643:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff921875a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592902.461655:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744774700 x1875475226070272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592902.461686:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226069760:0@lo:400:kworker.0 00000100:00100000:2.0:1788592902.461747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592902.461784:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788592902.461791:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70647b28-81c8-4371-870a-35a99a7dd483:3640:1875475226069632:0@lo:400:kworker.0 00000100:00100000:1.0:1788592902.461928:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226070144:0@lo:8:kworker.0 00000400:00000100:1.0:1788592902.461953:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226070144 offset 0 length 520: 4 00000100:00100000:1.0:1788592902.461977:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226070272:0@lo:8:kworker.0 00000400:00000100:1.0:1788592902.461991:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475226070272 offset 0 length 520: 4 00000100:00100000:2.0:1788592902.462150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592902.462183:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226070400:0@lo:400:kworker.0 00000100:00100000:2.0:1788592902.462210:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592902.462238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226069888:0@lo:400:kworker.0 00000100:00100000:2.0:1788592902.462260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592902.462279:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592902.462284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226070016:0@lo:400:kworker.0 00000100:00100000:2.0:1788592902.462305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592902.462336:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069760 00000100:00100000:2.0:1788592902.462343:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069760 00000100:00100000:2.0:1788592902.462376:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226070016 00000100:00100000:2.0:1788592902.462378:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226070016 00000100:00100000:3.0:1788592902.462418:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226070400 00000100:00100000:3.0:1788592902.462422:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226070400 00000100:00100000:3.0:1788592902.462458:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069888 00000100:00100000:3.0:1788592902.462462:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069888 00000100:00100000:3.0:1788592902.462478:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592902.462487:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226070400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592902.462498:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226069632 00000100:00100000:1.0:1788592902.462502:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226069632 00000100:00100000:1.0:1788592902.462528:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592902.462534:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921852dd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:3640:x1875475226069632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592902.462537:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226070400:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592902.462543:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592902.462558:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592902.462561:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921852dd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+18:3640:x1875475226069632:12345-0@lo:400:kworker.0 Request processed in 28us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592902.462563:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226069888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592902.462568:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788592902.462590:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226069888:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592902.462597:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592902.462631:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592902.462638:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226069760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592902.462669:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226069760:12345-0@lo:400:kworker.0 Request processed in 32us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592902.462675:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592902.462805:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70647b28-81c8-4371-870a-35a99a7dd483:3640:1875475226069632:0@lo:400:kworker.0 00010000:00080000:3.0:1788592902.462817:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921744776680 x1875475226070400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592902.462827:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226070400:0@lo:400:kworker.0 00000100:00100000:3.0:1788592902.462835:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226069760:0@lo:400:kworker.0 00010000:00080000:3.0:1788592902.462878:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92186d508e00 x1875475226069888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592902.462887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226069888:0@lo:400:kworker.0 00000100:00100000:2.0:1788592902.464919:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592902.464934:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592902.465014:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226070016:12345-0@lo:400:kworker.0 Request processed in 85us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592902.465021:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592902.465082:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226070016:0@lo:400:kworker.0 00010000:00010000:2.0:1788592903.354667:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592903.482946:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226070528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592903.483010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592903.483057:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226070528 00000100:00100000:1.0:1788592903.483087:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226070528 00000100:00100000:1.0:1788592903.483131:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592903.483139:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226070528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592903.483170:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788592903.483216:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226070528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592903.483224:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592903.483268:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226070528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592903.483900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226070656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592903.483939:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592903.483986:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226070656 00000100:00100000:1.0:1788592903.483991:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226070656 00000100:00100000:1.0:1788592903.484018:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592903.484025:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226070656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592903.484047:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788592903.484112:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226070656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592903.484118:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592903.484152:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226070656:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788592903.488822:0:17911:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788592903.736956:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592904.376271:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788592904.858324:0:18678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788592904.858327:0:18678:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788592904.858329:0:18678:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788592904.858611:0:18678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92186f49a000 00000020:01000004:0.0:1788592904.858625:0:18678:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788592904.858639:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788592904.858653:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92184754b380) 00000020:00000080:0.0:1788592904.858668:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788592904.921032:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788592904.921737:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788592904.922262:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788592904.922593:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788592904.922777:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788592904.923165:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788592904.923919:0:18678:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788592904.930331:0:18678:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788592904.930539:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788592904.930559:0:18678:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788592904.930570:0:18678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd314a3362db6047 00000020:01000004:2.0:1788592904.930577:0:18678:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788592904.930598:0:18678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788592904.930602:0:18678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788592904.930608:0:18678:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788592904.930612:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788592904.930623:0:18678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92187d78cd40) 00000020:00000080:2.0:1788592904.930635:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788592904.932298:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592904.932459:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788592904.932465:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788592904.942710:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788592904.942728:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788592904.943229:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788592904.943237:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788592904.947576:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592904.947755:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788592904.947762:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788592904.949292:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788592904.949303:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788592904.980974:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592904.981279:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788592904.981285:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788592904.982690:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788592904.982754:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788592904.984607:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788592904.984620:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788592904.987515:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592904.987934:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788592904.987940:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788592904.990737:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788592904.990751:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788592905.038702:0:18678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592905.039241:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788592905.039248:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788592905.044518:0:18678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788592905.044538:0:18678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788592905.047006:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788592905.047040:0:18678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788592905.047046:0:18678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788592905.066049:0:18678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788592905.066123:0:18678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.147@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788592905.066127:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788592905.066129:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788592905.066135:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592905.066136:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592905.066137:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592905.066138:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592905.066139:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592905.066141:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592905.066142:0:18678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592905.066145:0:18678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788592905.066147:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788592905.066149:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788592905.066150:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592905.066150:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592905.066151:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592905.066152:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592905.066153:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592905.066154:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592905.066155:0:18678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592905.066182:0:18678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788592905.066200:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226070784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788592905.066273:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592905.066374:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921850ed5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.066997:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226070784 00000100:00100000:1.0:1788592905.067006:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226070784 00000100:00100000:1.0:1788592905.067277:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592905.067288:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921852dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:18678:x1875475226070784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788592905.067317:0:17174:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788592905.067320:0:17174:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788592905.067324:0:17174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788592905.067655:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921852dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:18678:x1875475226070784:12345-0@lo:253:mount.lustre.0 Request processed in 368us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.067663:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788592905.067736:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226070784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788592905.067747:0:18678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788592905.067749:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788592905.067751:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788592905.067752:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592905.067753:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592905.067754:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592905.067756:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592905.067757:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592905.067759:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592905.067760:0:18678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788592905.067787:0:18678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92186f49a000 from lustre-OST0000 10000000:01000000:3.0:1788592905.067812:0:18678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788592905.067826:0:18678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788592905.067834:0:18678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92174350b380 local copy 00010000:00010000:3.0:1788592905.067843:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592905.067966:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226070912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592905.067996:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592905.069120:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.069129:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226070912 00000100:00100000:2.0:1788592905.069137:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226070912 00000100:00100000:1.0:1788592905.069196:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788592905.069207:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:18678:x1875475226070912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592905.069338:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:18678:x1875475226070912:12345-0@lo:501:mount.lustre.0 Request processed in 134us (1341us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592905.069345:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788592905.070301:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226070912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788592905.070389:0:18678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788592905.070476:0:18678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788592905.070486:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.070496:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592905.070538:0:18678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92186f49a000 10000000:01000000:2.0:1788592905.070543:0:18678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788592905.070548:0:18678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788592905.070550:0:18678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592905.070555:0:18678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788592905.070558:0:18678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788592905.070587:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.070712:0:18678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.070723:0:18678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592905.070743:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592905.070968:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.071042:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.071218:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071040 00000100:00100000:1.0:1788592905.071231:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071040 00000100:00100000:1.0:1788592905.071274:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788592905.071283:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+18:18678:x1875475226071040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592905.071293:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592905.071307:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022b400/0xbd314a3362db605c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6055 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592905.071329:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022b400/0xbd314a3362db605c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6055 expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592905.071339:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022b400/0xbd314a3362db605c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6055 expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592905.071348:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b400, rc 0) 00000100:00100000:1.0:1788592905.071388:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071040:12345-0@lo:101:mount.lustre.0 Request processed in 107us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.071394:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592905.071539:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592905.071552:0:18678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db605c expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.071562:0:18678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db605c expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592905.075554:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788592905.077599:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592905.079800:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788592905.080032:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788592905.080091:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788592905.080109:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788592905.080123:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788592905.080135:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788592905.080157:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788592905.080162:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788592905.080256:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592905.080397:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.080505:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.080944:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071168 00000100:00100000:1.0:1788592905.080951:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071168 00000100:00100000:1.0:1788592905.081001:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788592905.081009:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592905.081304:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071168:12345-0@lo:501:mount.lustre.0 Request processed in 295us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.081314:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592905.081524:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592905.081563:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592905.081768:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.081862:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592905.082014:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071296 00000100:00100000:0.0:1788592905.082020:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071296 00000100:00100000:3.0:1788592905.082273:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788592905.082284:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592905.083200:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071296:12345-0@lo:503:mount.lustre.0 Request processed in 915us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.083208:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788592905.083314:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788592905.083745:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592905.083979:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592905.084024:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592905.084150:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.084759:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071424 00000100:00100000:2.0:1788592905.084767:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071424 00000100:00100000:1.0:1788592905.084838:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788592905.084848:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788592905.086049:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071424:12345-0@lo:502:mount.lustre.0 Request processed in 1198us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.086094:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788592905.086278:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592905.086505:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788592905.086531:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788592905.086542:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788592905.086552:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788592905.086563:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788592905.086573:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788592905.086583:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788592905.086848:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788592905.086874:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788592905.086899:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788592905.086912:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788592905.086923:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788592905.086956:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592905.087007:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592905.087047:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742719900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592905.087202:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071552 00000100:00100000:3.0:1788592905.087208:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071552 00000100:00100000:3.0:1788592905.087245:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788592905.087253:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592905.087351:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071552:12345-0@lo:502:mount.lustre.0 Request processed in 98us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.087358:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788592905.087583:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592905.087629:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788592905.087637:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788592905.088595:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788592905.088603:0:18695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788592905.088610:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.088612:0:18695:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788592905.088618:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592905.088631:0:18695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff921847548000) 00000020:00000080:0.0:1788592905.088652:0:18695:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788592905.088658:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788592905.088735:0:18695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92186f49a000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788592905.088743:0:18695:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788592905.088750:0:18695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd314a3362db606a 00010000:00010000:1.0:1788592905.098715:0:18695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788592905.100048:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788592905.102786:0:18695:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788592905.104118:0:18695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788592905.104130:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592905.104136:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592905.104138:0:18695:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788592905.104141:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788592905.104144:0:18695:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788592905.104145:0:18695:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592905.104147:0:18695:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592905.104148:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788592905.104151:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592905.104160:0:18695:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788592905.104163:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592905.104167:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592905.104168:0:18695:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592905.104171:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592905.104172:0:18695:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788592905.104175:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592905.104177:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592905.104178:0:18695:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788592905.104180:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592905.104183:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592905.104184:0:18695:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788592905.104187:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788592905.104213:0:18695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592905.104216:0:18695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592905.104217:0:18695:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788592905.104221:0:18695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788592905.104466:0:18678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788592905.104496:0:18678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788592905.104521:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db605c expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.104533:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820ec00/0xbd314a3362db6055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db605c expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592905.104542:0:18678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92186f49a000 from 1 10000000:01000000:2.0:1788592905.104544:0:18678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592905.104581:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.104589:0:18678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.104610:0:18678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592905.104634:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592905.104700:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.104734:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.104806:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071680 00000100:00100000:1.0:1788592905.104814:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071680 00000100:00100000:1.0:1788592905.104867:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788592905.104885:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:18678:x1875475226071680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592905.104898:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592905.104912:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6071 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592905.104934:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6071 expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592905.104944:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6071 expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592905.104952:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a800, rc 0) 00000100:00100000:1.0:1788592905.104988:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226071680:12345-0@lo:101:mount.lustre.0 Request processed in 113us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.104995:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788592905.108695:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592905.108725:0:18678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.108738:0:18678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592905.110296:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788592905.110550:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592905.110719:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788592905.110742:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788592905.110756:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788592905.110761:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788592905.110826:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592905.111510:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.112490:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592905.115726:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071808 00000100:00100000:3.0:1788592905.115739:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071808 00000100:00100000:3.0:1788592905.115906:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788592905.115917:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226071808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592905.116113:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226071808:12345-0@lo:501:mount.lustre.0 Request processed in 197us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.116120:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788592905.116221:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592905.116269:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592905.116323:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.116797:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743855b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.117347:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226071936 00000100:00100000:1.0:1788592905.117354:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226071936 00000100:00100000:1.0:1788592905.117388:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788592905.117396:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226071936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592905.117688:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226071936:12345-0@lo:503:mount.lustre.0 Request processed in 292us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.117701:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788592905.119052:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226071936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788592905.120704:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592905.120871:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592905.121009:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.121123:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.121387:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072064 00000100:00100000:1.0:1788592905.121395:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072064 00000100:00100000:1.0:1788592905.121502:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592905.121512:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226072064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788592905.121636:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226072064:12345-0@lo:502:mount.lustre.0 Request processed in 125us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.121642:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788592905.121758:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592905.122324:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788592905.122357:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788592905.122373:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788592905.122402:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788592905.122418:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788592905.122550:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788592905.122566:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788592905.122580:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788592905.122593:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788592905.122607:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788592905.122619:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788592905.122649:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592905.122701:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.122783:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592905.123531:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072192 00000100:00100000:0.0:1788592905.123539:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072192 00000100:00100000:0.0:1788592905.123587:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788592905.123596:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226072192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592905.124131:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226072192:12345-0@lo:502:mount.lustre.0 Request processed in 535us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592905.124140:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592905.124257:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592905.124451:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788592905.124462:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788592905.125496:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592905.125506:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.125508:0:18699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592905.125514:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92186f49a000 00000020:00000080:0.0:1788592905.125517:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592905.125525:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592905.125527:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.125528:0:18699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788592905.125530:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592905.125533:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.125534:0:18699:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592905.125537:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92186f49a000 00000020:00000080:0.0:1788592905.125539:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592905.125628:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592905.125632:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.125633:0:18699:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788592905.125702:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592905.125707:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.125708:0:18699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592905.125712:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92186f49a000 00000020:00000080:0.0:1788592905.125714:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592905.131267:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592905.131501:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.131504:0:18699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592905.131511:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592905.131516:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.131518:0:18699:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788592905.131524:0:18699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92186f49a000 00000020:00000080:0.0:1788592905.131527:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592905.131607:0:18699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592905.131610:0:18699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592905.131611:0:18699:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788592905.131615:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788592905.132465:0:18678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788592905.132496:0:18678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592905.132520:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.132543:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592905.132604:0:18678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788592905.132607:0:18678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92186f49a000 10000000:01000000:2.0:1788592905.132610:0:18678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92186f49a000 10000000:01000000:2.0:1788592905.132614:0:18678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592905.132620:0:18678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92186f49a000 from 1 10000000:01000000:2.0:1788592905.132622:0:18678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592905.132668:0:18678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.132677:0:18678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.132688:0:18678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592905.132711:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592905.132775:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.132814:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592905.134786:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072320 00000100:00100000:3.0:1788592905.134799:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072320 00000100:00100000:3.0:1788592905.134897:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788592905.134913:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:18678:x1875475226072320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592905.134929:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592905.134946:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92188205ee00/0xbd314a3362db6086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db607f expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.134982:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205ee00/0xbd314a3362db6086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db607f expref: 21 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.134993:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92188205ee00/0xbd314a3362db6086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db607f expref: 21 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.135002:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92188205ee00, rc 0) 00000100:00100000:3.0:1788592905.135098:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072320:12345-0@lo:101:mount.lustre.0 Request processed in 192us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.135106:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788592905.139569:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592905.139599:0:18678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6086 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.139613:0:18678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db6086 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592905.144502:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788592905.145583:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592905.146205:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788592905.146252:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788592905.146274:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788592905.146778:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788592905.146795:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788592905.146806:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788592905.146822:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788592905.146834:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788592905.146849:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788592905.146878:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788592905.146898:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788592905.146912:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788592905.146926:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788592905.146942:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788592905.146954:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788592905.146966:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788592905.146978:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788592905.147008:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788592905.147024:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788592905.147037:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788592905.147050:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788592905.147062:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788592905.147100:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788592905.147116:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788592905.147131:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788592905.147145:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788592905.147158:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788592905.147172:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788592905.147188:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788592905.147217:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788592905.147236:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788592905.147252:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788592905.147270:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788592905.147838:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788592905.147875:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788592905.147895:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788592905.147914:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788592905.148045:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788592905.148054:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788592905.148169:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592905.148237:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.148868:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217439753c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.149796:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072448 00000100:00100000:1.0:1788592905.149807:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072448 00000100:00100000:1.0:1788592905.149936:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788592905.149947:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592905.150143:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072448:12345-0@lo:501:mount.lustre.0 Request processed in 198us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.150151:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788592905.150612:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592905.150818:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592905.150881:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592905.151001:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185822f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.151032:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072576 00000100:00100000:2.0:1788592905.151038:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072576 00000100:00100000:2.0:1788592905.151089:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788592905.151098:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592905.151193:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072576:12345-0@lo:503:mount.lustre.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.151199:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788592905.151356:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788592905.151804:0:18678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592905.151896:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592905.151940:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592905.151965:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186bac7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.152229:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072704 00000100:00100000:2.0:1788592905.152234:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072704 00000100:00100000:2.0:1788592905.152270:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788592905.152277:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592905.152378:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072704:12345-0@lo:502:mount.lustre.0 Request processed in 101us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.152386:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788592905.152628:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592905.152823:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788592905.152876:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788592905.152898:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788592905.152916:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788592905.152931:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788592905.152946:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788592905.152964:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788592905.152981:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788592905.152998:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788592905.153015:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788592905.153035:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788592905.153054:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788592905.153095:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788592905.153116:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788592905.153133:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788592905.153148:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788592905.153166:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788592905.153196:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788592905.153214:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788592905.153247:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788592905.153264:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788592905.153278:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788592905.153294:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788592905.153630:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788592905.153711:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788592905.153725:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788592905.153737:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788592905.153748:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788592905.153762:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788592905.153773:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788592905.153784:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788592905.153797:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788592905.153810:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788592905.153837:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788592905.153862:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788592905.153878:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788592905.153889:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788592905.153902:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788592905.153914:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788592905.153926:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788592905.153938:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788592905.153950:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788592905.153962:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788592905.153973:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788592905.153983:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788592905.153994:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788592905.154005:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788592905.154017:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788592905.154095:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592905.154156:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592905.154198:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186bac7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.154445:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072832 00000100:00100000:2.0:1788592905.154459:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072832 00000100:00100000:2.0:1788592905.154504:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788592905.154513:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592905.154610:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072832:12345-0@lo:502:mount.lustre.0 Request processed in 99us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.154618:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592905.154893:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592905.155052:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788592905.155106:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788592905.155134:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592905.155174:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592905.155194:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186bac7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.155246:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226072960 00000100:00100000:2.0:1788592905.155251:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226072960 00000100:00100000:2.0:1788592905.155279:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788592905.155513:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592905.155585:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226072960:12345-0@lo:502:mount.lustre.0 Request processed in 299us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.155592:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788592905.155736:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226072960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592905.155778:0:18678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788592905.155787:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788592905.157805:0:18704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788592905.157822:0:18704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92187d7899c0) 00000020:00000080:2.0:1788592905.157846:0:18704:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788592905.157928:0:18704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92186f49a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788592905.157932:0:18704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92186f49a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788592905.157935:0:18704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92186f49a000 3 00010000:00080000:2.0:1788592905.157961:0:18704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92174390e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.147@tcp at head 00010000:00010000:2.0:1788592905.162249:0:18704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788592905.164142:0:18704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788592905.164211:0:18704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592905.164226:0:18704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbd314a3362db6094 00000100:00080000:2.0:1788592905.164238:0:18704:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592905.164245:0:18704:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92174390e000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592905.165606:0:18704:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744777100 x1875475226073088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592905.165659:0:18704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788592905.166004:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226073088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788592905.166102:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788592905.166200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592905.166204:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592905.166208:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592905.166211:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592905.166238:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592905.166240:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592905.166243:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592905.166246:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592905.166564:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073088 00000100:00100000:2.0:1788592905.166573:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073088 00000100:00100000:2.0:1788592905.166622:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592905.166629:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1875475226073088:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592905.166747:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226073216:0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.166784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592905.166805:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592905.166810:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226073600:0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.166829:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592905.166870:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226073344:0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.166890:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592905.166900:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592905.166904:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226073472:0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.166920:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592905.166968:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073216 00000100:00100000:1.0:1788592905.166972:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073216 00000100:00100000:1.0:1788592905.166993:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073472 00000100:00100000:1.0:1788592905.166996:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073472 00000100:00100000:1.0:1788592905.167017:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592905.167023:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226073216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.167080:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226073216:12345-0@lo:400:kworker.0 Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.167087:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592905.167101:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592905.167106:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226073472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.167131:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226073472:12345-0@lo:400:kworker.0 Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.167136:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592905.167149:0:17180:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788592905.167155:0:17180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788592905.167187:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226073216:0@lo:400:kworker.0 00000100:00100000:1.0:1788592905.167211:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226073472:0@lo:400:kworker.0 00000100:00100000:3.0:1788592905.167891:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592905.167904:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073600 00000100:00100000:3.0:1788592905.167909:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073600 00000100:00100000:3.0:1788592905.167990:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592905.168003:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073344 00000100:00100000:3.0:1788592905.168006:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073344 00000100:00100000:3.0:1788592905.168022:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592905.168029:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592905.168036:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226073600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592905.168138:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226073600:12345-0@lo:400:kworker.0 Request processed in 101us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.168145:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592905.168157:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592905.168163:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592905.168169:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226073344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592905.168204:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226073344:12345-0@lo:400:kworker.0 Request processed in 35us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.168210:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788592905.168461:0:17181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788592905.168498:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbd314a3362db609b 00000004:00100000:2.0:1788592905.168512:0:17181:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592905.168541:0:17181:0:(import.c:65:import_set_state_nolock()) ffff92174390a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592905.168594:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875475226073088:12345-0@lo:38:llog_process_th.0 Request processed in 1964us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.168601:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788592905.168712:0:18704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788592905.168734:0:18704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff92174249cd40) 00000020:00000080:2.0:1788592905.168753:0:18704:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788592905.168824:0:18704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92186f49a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788592905.168828:0:18704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92186f49a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788592905.168830:0:18704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92186f49a000 3 00010000:00080000:2.0:1788592905.168868:0:18704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff921852d47800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.147@tcp at head 00010000:00080000:3.0:1788592905.168893:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921744777100 x1875475226073088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592905.168904:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788592905.168911:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788592905.168917:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788592905.168920:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788592905.168980:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92174390e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788592905.168987:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1875475226073088:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788592905.170569:0:18704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00010000:00080000:1.0:1788592905.171511:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92174360dc00 x1875475226073600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592905.171527:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226073600:0@lo:400:kworker.0 00010000:00080000:1.0:1788592905.171571:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92174360df80 x1875475226073344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592905.171581:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226073344:0@lo:400:kworker.0 00000020:00000080:2.0:1788592905.174405:0:18704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788592905.174580:0:18704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592905.174593:0:18704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbd314a3362db60a9 00000100:00080000:2.0:1788592905.174603:0:18704:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592905.174609:0:18704:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff921852d47800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592905.174706:0:18704:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744777800 x1875475226073728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592905.174758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1875475226073728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788592905.174836:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592905.175333:0:18704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788592905.175758:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073728 00000100:00100000:1.0:1788592905.175771:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073728 00000100:00100000:1.0:1788592905.175806:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592905.175813:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226073728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788592905.175837:0:17180:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1788592905.175889:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbd314a3362db60b0 00000004:00100000:1.0:1788592905.175904:0:17180:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788592905.175934:0:17180:0:(import.c:65:import_set_state_nolock()) ffff9217447fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592905.175991:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875475226073728:12345-0@lo:38:llog_process_th.0 Request processed in 177us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592905.175999:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788592905.176042:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff921744777800 x1875475226073728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592905.176052:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592905.176059:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788592905.176123:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788592905.176128:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788592905.176131:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921852d47800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788592905.176137:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1875475226073728:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788592905.179667:0:18704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788592905.179783:0:18678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788592905.179813:0:18678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592905.179839:0:18678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6086 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.179862:0:18678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185820e800/0xbd314a3362db607f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6086 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788592905.179908:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788592905.179911:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592905.179912:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592905.179913:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592905.179915:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592905.179917:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592905.179918:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592905.179920:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592905.179921:0:18678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592905.179925:0:18678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788592905.179928:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592905.179929:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592905.179930:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592905.179931:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592905.179932:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592905.179933:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592905.179934:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592905.179935:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592905.179936:0:18678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592905.179961:0:18678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788592905.179978:0:18678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226073856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788592905.180054:0:18678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.180111:0:18678:0:(client.c:2716:ptlrpc_set_wait()) set ffff921741084c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592905.180131:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073856 00000100:00100000:2.0:1788592905.180138:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073856 00000100:00100000:2.0:1788592905.180178:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788592905.180188:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226073856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788592905.180212:0:17172:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788592905.180225:0:17172:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788592905.182128:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788592905.182136:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788592905.182139:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788592905.182142:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788592905.182146:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788592905.182150:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788592905.182153:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788592905.182157:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:2.0:1788592905.187546:0:17172:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788592905.187567:0:17172:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788592905.187941:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:18678:x1875475226073856:12345-0@lo:253:mount.lustre.0 Request processed in 7742us (7874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.187954:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788592905.188018:0:18678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:18678:1875475226073856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788592905.188031:0:18678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788592905.188034:0:18678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592905.188036:0:18678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592905.188037:0:18678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592905.188038:0:18678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592905.188039:0:18678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592905.188041:0:18678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592905.188042:0:18678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592905.188044:0:18678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592905.188046:0:18678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788592905.188061:0:18678:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788592905.188800:0:17195:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592905.188805:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592905.188823:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.188838:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.188862:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6008 expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.188871:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.188904:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db6008 expref: 20 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.188918:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db6008 expref: 20 pid: 17174 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592905.188939:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226073984:0@lo:104: 00000100:00100000:3.0:1788592905.188981:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592905.189034:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.189043:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592905.189051:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226074112:0@lo:104: 00000100:00100000:3.0:1788592905.189096:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592905.189122:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184fea06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592905.189130:0:17163:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788592905.189143:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226073984 00000100:00100000:1.0:1788592905.189146:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074112 00000100:00100000:3.0:1788592905.189149:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226073984 00000100:00100000:1.0:1788592905.189152:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074112 00000100:00100000:3.0:1788592905.189185:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592905.189869:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:17195:x1875475226073984:12345-0@lo:104: 00010000:00010000:3.0:1788592905.189884:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.189956:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592905.189962:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:17195:x1875475226073984:12345-0@lo:104: Request processed in 770us (981us total) trans 0 rc 0/0 00010000:00010000:2.0:1788592905.190037:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592905.190044:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190050:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f600 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592905.190055:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190090:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592905.190097:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592905.190102:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592905.190132:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190137:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592905.190157:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190164:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185820f600/0xbd314a3362db6008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db600f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190174:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592905.190176:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592905.190177:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592905.190195:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226074240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592905.190224:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.190264:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074240 00000100:00100000:2.0:1788592905.190269:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074240 00010000:00010000:2.0:1788592905.190287:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6008 expref: 21 pid: 17174 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592905.190309:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592905.190316:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70647b28-81c8-4371-870a-35a99a7dd483+21:3642:x1875475226074240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592905.190333:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592905.190339:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6008 expref: 21 pid: 17174 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190350:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db6008 expref: 21 pid: 17174 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.190366:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592905.190393:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70647b28-81c8-4371-870a-35a99a7dd483+21:3642:x1875475226074240:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.190400:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592905.190452:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226074240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592905.193528:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592905.193568:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592905.193582:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921848c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226074112:12345-0@lo:104: 00010000:00010000:3.0:1788592905.193599:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.193685:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592905.193692:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921848c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226074112:12345-0@lo:104: Request processed in 116us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592905.193698:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788592905.193714:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592905.193723:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592905.193732:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1e00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592905.193736:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592905.193758:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592905.193766:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592905.193769:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f0600/0xbd314a3362db600f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db6008 expref: 20 pid: 17174 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592905.193778:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592905.193819:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592905.193825:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592905.193844:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592905.193862:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9217439f1e00/0xbd314a3362db5ffa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6001 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592905.193876:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592905.193878:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592905.193880:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592905.193897:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226073984:0@lo:104: 00000100:00100000:3.0:1788592905.193911:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226074112:0@lo:104: 00010000:00010000:3.0:1788592905.193929:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788592905.197544:0:18678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788592905.198259:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226074368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592905.198759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592905.199005:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074368 00000100:00100000:2.0:1788592905.199013:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074368 00010000:00010000:2.0:1788592905.199045:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592905.199100:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592905.199110:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921848c08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+20:3639:x1875475226074368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592905.199124:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592905.199130:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199143:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199161:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185022aa00/0xbd314a3362db6001 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db5ffa expref: 20 pid: 17175 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199187:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199197:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592905.199211:0:17167:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010406516s 00010000:00010000:2.0:1788592905.199216:0:17167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199223:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199231:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199238:0:17167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199244:0:17167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592905.199249:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199258:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199274:0:17167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199286:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592905.199328:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921848c08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+19:3639:x1875475226074368:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592905.199335:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788592905.199382:0:17195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199390:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592905.199396:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205e600/0xbd314a3362db60b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592905.199641:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226074368:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1788592905.201475:0:18678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788592905.201483:0:18678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788592905.201519:0:18678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592905.201555:0:18678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592905.201570:0:18678:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788592905.201591:0:18678:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788592905.203879:0:18678:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592905.205745:0:18678:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788592905.274613:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788592905.401782:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788592906.168891:0:18759:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592906.169571:0:18759:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788592906.232419:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592891/real 1788592891] req@ffff92186d508700 x1875475226061568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592906 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592906.232463:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92186d508700 x1875475226061568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592906 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592906.232472:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592891/real 1788592891] req@ffff92186d50a300 x1875475226061696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592906 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592906.232483:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92186d50a300 x1875475226061696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592906 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592906.232501:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218696ac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592906.232524:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788592906.232528:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061568:0@lo:8:kworker.0 00000100:00080000:1.0:1788592906.232533:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592906.232537:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788592906.232540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226061696:0@lo:8:kworker.0 00000100:00080000:2.0:1788592906.234251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592906.234257:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788592906.234261:0:37:0:(import.c:65:import_set_state_nolock()) ffff9218696ac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592906.234267:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788592906.234274:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788592906.234281:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9218696ac800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592906.234299:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744775180 x1875475226074752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592906.234314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592906.234317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788592906.234319:0:37:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592906.234321:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788592906.234324:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788592906.234333:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592906.234344:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744776d80 x1875475226074880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592906.234366:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592906.234368:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592906.234371:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592906.234374:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592906.234411:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226074624:0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.234473:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.234504:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226075392:0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.234533:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.234557:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788592906.234562:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226075008:0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.234585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.234602:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226075520:0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.234621:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.234647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226074752:0@lo:8:kworker.0 00000100:00100000:2.0:1788592906.234670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.234696:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226074880:0@lo:8:kworker.0 00000100:00100000:2.0:1788592906.234714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.234741:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074624 00000100:00100000:2.0:1788592906.234749:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074624 00000100:00100000:2.0:1788592906.234789:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592906.234796:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226074624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.234862:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226074624:12345-0@lo:400:kworker.0 Request processed in 65us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.234869:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592906.234893:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075392 00000100:00100000:2.0:1788592906.234897:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075392 00000100:00100000:2.0:1788592906.234934:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075008 00000100:00100000:2.0:1788592906.234937:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075008 00000100:00100000:2.0:1788592906.234948:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075520 00000100:00100000:2.0:1788592906.234950:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075520 00000100:00100000:2.0:1788592906.234964:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592906.234969:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226075392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.234997:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226075392:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.235003:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592906.235013:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592906.235018:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.235042:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226075008:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.235048:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592906.235057:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592906.235062:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226075520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.235111:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226075520:12345-0@lo:400:kworker.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.235116:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592906.235142:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074752 00000100:00100000:2.0:1788592906.235146:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074752 00000100:00100000:2.0:1788592906.235158:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074880 00000100:00100000:2.0:1788592906.235167:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074880 00000100:00100000:2.0:1788592906.235179:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592906.235183:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226074752:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788592906.235206:0:18682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788592906.235242:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db60be 00002000:00100000:2.0:1788592906.235255:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92174390a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788592906.235259:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788592906.235262:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788592906.235428:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226075136:0@lo:400:kworker.0 00002000:00080000:2.0:1788592906.235442:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788592906.235459:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592906.235463:0:18682:0:(import.c:65:import_set_state_nolock()) ffff921743909000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592906.235480:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788592906.235486:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226074496:0@lo:400:kworker.0 00000100:00100000:2.0:1788592906.235497:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875475226074752:12345-0@lo:8:kworker.0 Request processed in 313us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.235503:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592906.235516:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592906.235519:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592906.235520:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226074880:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788592906.235531:0:18682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788592906.235542:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226075264:0@lo:400:kworker.0 00000100:00100000:3.0:1788592906.235561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592906.235586:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075264 00000100:00100000:3.0:1788592906.235589:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075264 00000100:00100000:3.0:1788592906.235615:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592906.235621:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226075264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592906.235653:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226075264:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592906.235658:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592906.235677:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226074496 00000100:00100000:3.0:1788592906.235681:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226074496 00000100:00100000:3.0:1788592906.235704:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788592906.235710:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:3639:x1875475226074496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592906.235737:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+19:3639:x1875475226074496:12345-0@lo:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592906.235743:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788592906.235768:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075136 00000100:00100000:3.0:1788592906.235771:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075136 00000100:00100000:3.0:1788592906.235786:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788592906.235791:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226075136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592906.235816:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226075136:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592906.235822:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788592906.235860:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226074496:0@lo:400:kworker.0 00010000:00080000:3.0:1788592906.235882:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744777800 x1875475226075264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592906.235900:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226075264:0@lo:400:kworker.0 00000100:00100000:3.0:1788592906.235916:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226075136:0@lo:400:kworker.0 00000100:00080000:1.0:1788592906.235934:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592906.235937:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788592906.235978:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744777b80 x1875475226075008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592906.235987:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226075008:0@lo:400:kworker.0 00010000:00080000:3.0:1788592906.236000:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744775500 x1875475226075520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592906.236007:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226075520:0@lo:400:kworker.0 00000100:00100000:3.0:1788592906.236017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226074624:0@lo:400:kworker.0 00010000:00080000:3.0:1788592906.236026:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744777100 x1875475226075392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592906.236033:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226075392:0@lo:400:kworker.0 00010000:00080000:3.0:1788592906.236081:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744775180 x1875475226074752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592906.236089:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788592906.236095:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788592906.236102:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788592906.236106:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788592906.236109:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218696ac800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788592906.236131:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788592906.236136:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226074752:0@lo:8:kworker.0 00000004:00080000:3.0:1788592906.236170:0:17203:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788592906.236240:0:17203:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440483172835ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788592906.236246:0:17203:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788592906.236327:0:17204:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788592906.236343:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17204:1875475226075776:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788592906.236385:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592906.236402:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186bac7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592906.236418:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788592906.236424:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788592906.236442:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592906.236450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226075648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592906.236475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592906.236691:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075648 00000100:00100000:1.0:1788592906.236696:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075648 00000100:00100000:1.0:1788592906.236768:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592906.236776:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226075648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592906.236790:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:1.0:1788592906.236828:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875475226075648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592906.236834:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788592906.239273:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92174477aa00 x1875475226075648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592906.239313:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226075648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592906.239361:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075776 00000100:00100000:1.0:1788592906.239367:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075776 00000100:00100000:1.0:1788592906.239476:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592906.239485:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17204:x1875475226075776:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788592906.239739:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788592906.240290:0:17160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788592906.243188:0:18763:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788592906.243202:0:18763:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788592906.243208:0:18763:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:2.0:1788592906.255549:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226074880:12345-0@lo:8:kworker.0 Request processed in 20020us (20826us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592906.255564:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788592906.260047:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592906.260058:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788592906.260063:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226074880:0@lo:8:kworker.0 00002000:00010000:0.0:1788592906.274604:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.274617:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274635:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.274640:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.274646:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274666:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274677:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274685:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274714:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592906.274726:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592906.274731:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274739:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592906.274744:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274752:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274768:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274776:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d450d8c/0xbd314a3362db60c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.274794:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.274796:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.274798:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592906.275494:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.275501:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.275512:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.275521:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.275527:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.275537:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.275546:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.275553:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.275618:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.277250:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.277261:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.277272:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.277276:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.277299:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.277321:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.277329:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db916ee3/0xbd314a3362db60cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.277349:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.277351:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.277353:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592906.282581:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.282601:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282618:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.282624:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.282631:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282646:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282656:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282672:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282691:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592906.282703:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592906.282708:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282716:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592906.282721:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282730:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282745:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282752:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864cc892/0xbd314a3362db60d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.282769:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.282771:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.282773:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592906.285026:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.285045:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.285060:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.285079:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.285086:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.285101:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.285111:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.285119:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.285144:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788592906.286971:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.286983:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.286998:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.287001:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.287007:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287019:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287039:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287047:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287082:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788592906.287097:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592906.287103:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287112:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592906.287116:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287125:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287141:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287148:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fd959a7/0xbd314a3362db60da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287165:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592906.287173:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287179:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592906.287182:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287189:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287197:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287202:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db60e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.287212:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.287214:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.287216:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592906.288014:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.288022:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288034:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.288037:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.288042:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288332:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288345:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288352:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288409:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788592906.288825:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.288831:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288840:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.288853:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.288858:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288867:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288882:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.288902:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291283:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592906.291296:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291308:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.291314:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291323:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291348:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291355:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000098f0e5a/0xbd314a3362db60e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291375:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.291378:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291396:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.291399:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291407:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291417:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.291425:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.291427:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.291428:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592906.291634:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788592906.291642:0:18763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db60ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.292357:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788592906.292498:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788592906.292505:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.292518:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788592906.292523:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592906.292530:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.292544:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.292553:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.292561:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.292584:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592906.292854:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.292860:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.292868:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.292881:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.292892:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.292907:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.292920:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041b417db/0xbd314a3362db60f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.292939:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.292941:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.292942:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788592906.293056:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788592906.293098:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293107:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788592906.293111:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592906.293116:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293126:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293134:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293140:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293155:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592906.293431:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.293436:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.293443:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.293447:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.293454:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.293465:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.293472:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e97e528/0xbd314a3362db60fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.293486:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.293488:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.293489:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788592906.293592:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788592906.293597:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293605:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788592906.293608:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592906.293612:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293620:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293635:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293642:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.293659:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788592906.294046:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788592906.294051:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.294059:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788592906.294062:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592906.294144:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.294149:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.294156:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022be00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.294160:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.294166:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.294178:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.294185:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f49843/0xbd314a3362db6104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.294201:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.294203:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.294204:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592906.294241:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.294253:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.294261:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.294268:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.294328:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788592906.295132:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788592906.295139:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.295150:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788592906.295154:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592906.295159:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.295169:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.295178:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.295186:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.295196:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592906.295613:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592906.295621:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295630:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022ba00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.295634:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295642:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295659:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295680:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa5e303f/0xbd314a3362db610b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295700:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.295703:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295711:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.295715:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295723:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295733:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295740:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030d9a3bf/0xbd314a3362db6112 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.295752:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.295754:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.295755:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592906.296328:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.296335:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.296346:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.296350:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.296355:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.296368:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.296382:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.296389:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.296432:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.296762:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.296768:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.296781:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.296785:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.296794:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.296807:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.296815:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116590b4/0xbd314a3362db6119 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.296829:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.296831:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.296833:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592906.297511:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592906.297518:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.297529:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788592906.297532:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592906.297536:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.297547:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.297555:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.297563:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.297576:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.298089:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.298095:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.298104:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.298108:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.298116:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.298138:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.298145:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d9db704/0xbd314a3362db6120 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.298159:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.298161:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.298163:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.301203:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.301215:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301232:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.301237:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.301243:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301257:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301267:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301275:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301301:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.301313:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.301318:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301325:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ea00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.301329:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301337:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301353:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301360:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a77dba68/0xbd314a3362db6127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.301375:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.301377:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.301379:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.302143:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.302150:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302161:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.302171:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.302176:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302187:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302194:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302201:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302215:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.302223:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.302228:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302235:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820ee00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.302238:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302246:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302257:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302277:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073ad13df/0xbd314a3362db612e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302292:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.302293:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.302295:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.302612:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.302618:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302626:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.302630:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.302634:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302643:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302651:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302657:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302670:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.302676:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.302685:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302691:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.302695:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302703:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302713:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302720:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db6b3244/0xbd314a3362db6135 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.302733:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.302734:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.302735:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.303174:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592906.303405:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788592906.303423:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303434:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1788592906.303437:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592906.303442:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303460:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303468:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303476:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303495:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592906.303765:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592906.303771:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.303778:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592906.303783:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.303802:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.303816:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.303824:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3468cd/0xbd314a3362db613c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.303840:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.303850:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.303852:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592906.303946:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788592906.303952:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303961:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1788592906.303963:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592906.303968:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303977:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.303984:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304003:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304024:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592906.304031:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.304035:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304042:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.304045:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304052:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304063:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304098:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006529a450/0xbd314a3362db6143 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.304110:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.304112:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.304114:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.304795:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.304802:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.304811:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.304815:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.304819:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.304829:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.304838:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.304867:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.304896:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592906.305327:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.305333:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305342:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.305345:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.305349:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305358:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305366:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305372:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305384:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788592906.305663:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.305669:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305683:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.305686:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.305690:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305700:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305708:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305715:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.305723:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788592906.306012:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788592906.306019:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306032:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.306036:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306045:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306060:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306088:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b31c8e56/0xbd314a3362db614a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306104:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592906.306108:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306115:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820fa00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.306117:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306124:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306133:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306145:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab42d917/0xbd314a3362db6151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306156:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.306158:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306165:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820e400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.306168:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306175:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306184:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306192:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4626886/0xbd314a3362db6158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.306201:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.306203:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.306204:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.306209:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.306292:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.306297:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306305:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.306308:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.306313:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306321:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306339:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306346:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306364:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592906.306656:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.306662:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306671:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.306674:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.306678:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306687:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306695:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306703:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.306726:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788592906.307039:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592906.307045:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307061:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.307090:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307100:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307113:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307121:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000084d9d5/0xbd314a3362db615f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307137:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.307140:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307146:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.307149:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307156:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307165:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307179:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ee39ce1/0xbd314a3362db6166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307192:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.307193:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.307195:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.307201:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.307297:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.307303:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.307312:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.307315:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.307320:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.307329:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.307337:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.307343:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.307359:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592906.307576:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.307581:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307589:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820f200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.307592:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307599:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307611:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307618:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084502373/0xbd314a3362db616d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.307631:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.307633:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.307641:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.307866:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.307871:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.308163:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.308172:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.308176:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.308187:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.308195:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.308202:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.308218:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592906.308504:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592906.308510:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.308517:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592906.308527:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.308536:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.308548:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.308556:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df8905a/0xbd314a3362db6174 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.308571:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592906.308574:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592906.308576:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.308989:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.308995:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.309004:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.309008:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.309012:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.309021:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.309029:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.309042:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.309062:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592906.310147:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592906.310155:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.310165:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:3.0:1788592906.310170:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.310178:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.310194:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.310201:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d0d5cdb/0xbd314a3362db617b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.310218:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.310220:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592906.310222:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592906.310384:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592906.310390:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.310400:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788592906.310404:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592906.310409:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.310432:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.310439:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.310446:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.310498:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788592906.310552:0:18763:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788592906.310648:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17204:x1875475226075776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 71161us (74259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.310666:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592906.311761:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17204:1875475226075776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788592906.311779:0:17204:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788592906.311832:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17204:1875475226075904:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788592906.311897:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592906.311930:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186d7cfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592906.311984:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226075904 00000100:00100000:2.0:1788592906.311991:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226075904 00000100:00100000:2.0:1788592906.312043:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592906.312051:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17204:x1875475226075904:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788592906.312112:0:18685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1788592906.321465:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592906.321480:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.321492:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592906.321498:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.321528:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.321550:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592906.321578:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cce06525/0xbd314a3362db6182 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.325153:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.325160:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592906.325163:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788592906.325611:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788592906.325648:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788592906.325790:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17204:x1875475226075904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13735us (13889us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788592906.325804:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592906.325868:0:17204:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788592906.325875:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17204:1875475226075904:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788592906.325891:0:17204:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788592906.429661:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788592906.616160:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788592906.616168:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9218758fa000 from 9 10000000:01000000:3.0:1788592906.616172:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592906.616216:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.616229:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.616240:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592906.616266:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592906.616332:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592906.616383:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186961b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592906.616662:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076032 00000100:00100000:2.0:1788592906.616670:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076032 00000100:00100000:2.0:1788592906.616725:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788592906.616735:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+19:17177:x1875475226076032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592906.616748:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592906.616763:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6189 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.616787:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6189 expref: 20 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.616799:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6189 expref: 20 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.616809:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81000, rc 0) 00000100:00100000:2.0:1788592906.616877:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:17177:x1875475226076032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.616885:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788592906.616913:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592906.616929:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592906.616951:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592906.616999:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788592906.617031:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592906.617053:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186961b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592906.617605:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076160 00000100:00100000:2.0:1788592906.617619:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076160 00000100:00100000:2.0:1788592906.617655:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788592906.617662:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+20:17177:x1875475226076160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788592906.617676:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788592906.617693:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788592906.617696:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788592906.617785:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+20:17177:x1875475226076160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.617792:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788592906.617885:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788592906.617945:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788592906.617952:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.617971:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592906.617980:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788592906.617982:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92174444b000 from 9 10000000:01000000:0.0:1788592906.617985:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788592906.618005:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.618013:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.618021:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592906.618037:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592906.619395:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592906.619818:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186bac7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592906.620437:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076288 00000100:00100000:2.0:1788592906.620447:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076288 00000100:00100000:2.0:1788592906.620498:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788592906.620508:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:17177:x1875475226076288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592906.620520:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592906.620538:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6197 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.620565:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6197 expref: 21 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.620577:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6197 expref: 21 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592906.620586:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81200, rc 0) 00000100:00100000:2.0:1788592906.620664:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226076288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592906.620670:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788592906.620858:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592906.620877:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.620888:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592906.620953:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788592906.620993:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592906.621032:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186bac7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592906.621915:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076416 00000100:00100000:1.0:1788592906.621921:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076416 00000100:00100000:1.0:1788592906.621962:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788592906.621970:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226076416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788592906.621987:0:17174:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788592906.622006:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788592906.622009:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788592906.623358:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226076416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1384us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592906.623370:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788592906.623670:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226076416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788592906.623736:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788592906.623745:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592906.623756:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592907.451505:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592908.472967:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592908.601372:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226076544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592908.601455:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592908.601517:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076544 00000100:00100000:1.0:1788592908.601523:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076544 00000100:00100000:1.0:1788592908.601565:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592908.601572:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226076544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592908.601604:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788592908.601643:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226076544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592908.601649:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592908.601685:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226076544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592908.604164:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592908.604185:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226076672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592908.604250:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592908.605549:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076672 00000100:00100000:1.0:1788592908.605581:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076672 00000100:00100000:1.0:1788592908.605642:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788592908.605653:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226076672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592908.605689:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788592908.605768:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226076672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592908.605776:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592908.605915:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226076672:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788592909.496786:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592910.523976:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592911.440786:0:19050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788592911.547295:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788592911.672886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592911.672892:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788592911.672896:0:38:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788592911.672903:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1788592911.672909:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788592911.672916:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592911.672938:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921741ddad80 x1875475226077184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592911.672969:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592911.672973:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592911.672976:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592911.672979:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592911.673015:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226076800:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.673108:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.673483:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226077440:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.673512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.674903:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226077952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592911.674948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.674976:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788592911.674984:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226077312:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.675010:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.675030:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226077824:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.675050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.675115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226076928:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.675141:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592911.678774:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077312 00000100:00100000:0.0:1788592911.678786:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077312 00000100:00100000:0.0:1788592911.678837:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077824 00000100:00100000:0.0:1788592911.678840:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077824 00000100:00100000:0.0:1788592911.678885:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592911.678899:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226077312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592911.678992:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226077312:12345-0@lo:400:kworker.0 Request processed in 100us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592911.679001:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592911.679019:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592911.679025:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226077824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592911.679059:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226077824:12345-0@lo:400:kworker.0 Request processed in 34us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592911.679103:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788592911.681041:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788592911.681564:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226077568:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.681626:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.681657:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788592911.681667:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226077056:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.681697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.681721:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226077696:0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.682618:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077440 00000100:00100000:3.0:1788592911.682630:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077440 00000100:00100000:3.0:1788592911.682674:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076928 00000100:00100000:3.0:1788592911.682677:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076928 00000100:00100000:3.0:1788592911.682693:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592911.682701:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226077440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.683244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.683455:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226077184:0@lo:8:kworker.0 00000100:00100000:2.0:1788592911.683493:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592911.683527:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226076800 00000100:00100000:2.0:1788592911.683532:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226076800 00000100:00100000:2.0:1788592911.683565:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592911.683572:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:3642:x1875475226076800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.683606:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:3642:x1875475226076800:12345-0@lo:400:kworker.0 Request processed in 35us (10498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592911.683614:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592911.683650:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077952 00000100:00100000:2.0:1788592911.683654:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077952 00000100:00100000:2.0:1788592911.683687:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592911.683693:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226077952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592911.683715:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788592911.684219:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226077952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 524us (9269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592911.684227:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592911.684261:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077056 00000100:00100000:2.0:1788592911.684265:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077056 00000100:00100000:3.0:1788592911.684458:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226077440:12345-0@lo:400:kworker.0 Request processed in 1757us (10943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592911.684468:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592911.684485:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592911.684492:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226076928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.684533:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226076928:12345-0@lo:400:kworker.0 Request processed in 42us (9391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592911.684539:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592911.684556:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077568 00000100:00100000:3.0:1788592911.684568:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077568 00000100:00100000:3.0:1788592911.684598:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077696 00000100:00100000:3.0:1788592911.684601:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077696 00000100:00100000:3.0:1788592911.684616:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592911.684622:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226077568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.684655:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226077568:12345-0@lo:400:kworker.0 Request processed in 34us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592911.684662:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592911.684674:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592911.684680:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226077696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.684705:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226077696:12345-0@lo:400:kworker.0 Request processed in 26us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592911.684711:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788592911.684840:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226077184 00000100:00100000:2.0:1788592911.684845:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226077184 00000100:00100000:2.0:1788592911.684860:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592911.684866:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226077056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.684897:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226077056:12345-0@lo:400:kworker.0 Request processed in 31us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592911.684903:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592911.684915:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592911.684918:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226077184:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788592911.684937:0:18682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788592911.688435:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592911.688444:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592911.690928:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226077056:0@lo:400:kworker.0 00010000:00080000:3.0:1788592911.691012:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd9500 x1875475226077696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592911.691023:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226077696:0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.691040:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226076928:0@lo:400:kworker.0 00010000:00080000:3.0:1788592911.691052:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8380 x1875475226077568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592911.691060:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226077568:0@lo:400:kworker.0 00010000:00080000:3.0:1788592911.694212:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd8a80 x1875475226077312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592911.694250:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226077312:0@lo:400:kworker.0 00010000:00080000:3.0:1788592911.694277:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd9880 x1875475226077824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592911.694287:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226077824:0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.694310:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226077952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592911.694321:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226076800:0@lo:400:kworker.0 00000100:00100000:3.0:1788592911.694332:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226077440:0@lo:400:kworker.0 00000100:00100000:2.0:1788592911.715489:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226077184:12345-0@lo:8:kworker.0 Request processed in 30561us (31988us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592911.715504:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788592911.715553:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592911.715558:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592911.715562:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226077184:0@lo:8:kworker.0 00000020:00000004:1.0:1788592912.291987:0:19102:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592912.292351:0:19102:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788592912.568392:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788592913.059971:0:19152:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592913.060263:0:19152:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788592913.593143:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592913.721117:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592913.721137:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226078080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592913.721207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592913.721282:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078080 00000100:00100000:2.0:1788592913.721290:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078080 00000100:00100000:2.0:1788592913.721342:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592913.721351:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226078080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592913.721402:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788592913.721463:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226078080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592913.721472:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788592913.721485:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592913.721496:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226078208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592913.721530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592913.721655:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226078080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592913.721787:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078208 00000100:00100000:2.0:1788592913.721800:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078208 00000100:00100000:2.0:1788592913.721833:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592913.721840:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226078208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592913.721859:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788592913.721903:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226078208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592913.721908:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592913.721974:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226078208:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788592913.984078:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592914.616397:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788592915.513170:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788592915.641171:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592916.670713:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592916.795219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592916.795226:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788592916.795230:0:37:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592916.795239:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:3.0:1788592916.795244:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788592916.795250:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:2.0:1788592916.795387:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226078336:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.795505:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592916.795512:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226078464:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.795572:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078336 00000100:00100000:2.0:1788592916.795579:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078336 00000100:00100000:2.0:1788592916.795626:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592916.795647:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:3641:x1875475226078336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795693:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:3641:x1875475226078336:12345-0@lo:400:kworker.0 Request processed in 49us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592916.795701:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592916.795732:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078464 00000100:00100000:2.0:1788592916.795736:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078464 00000100:00100000:2.0:1788592916.795762:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592916.795768:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226078464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795813:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226078464:12345-0@lo:400:kworker.0 Request processed in 45us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592916.795829:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592916.795868:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226078464:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226078336:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795914:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592916.795923:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226078592:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.795950:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.796012:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078592 00000100:00100000:2.0:1788592916.796016:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078592 00000100:00100000:2.0:1788592916.796049:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592916.796055:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226078592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.796111:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226078592:12345-0@lo:400:kworker.0 Request processed in 56us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592916.796117:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592916.796142:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226078592:0@lo:400:kworker.0 00000100:00080000:2.0:1788592916.796164:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592916.796290:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592916.796300:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226078720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592916.796330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592916.796363:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078720 00000100:00100000:0.0:1788592916.796366:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078720 00000100:00100000:0.0:1788592916.796395:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592916.796401:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226078720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592916.796422:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788592916.796456:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226078720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592916.796462:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592916.796494:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226078720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592916.797137:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92186b9f3480 x1875475226078848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788592916.797183:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592916.797186:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788592916.797189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788592916.797192:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788592916.797231:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226079104:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.797272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.797314:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788592916.797321:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226078976:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.797346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.797362:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226079488:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.797381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.797403:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475226079360:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.797426:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.797440:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592916.797445:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226079232:0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.797464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592916.797487:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079104 00000100:00100000:2.0:1788592916.797491:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079104 00000100:00100000:2.0:1788592916.797518:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592916.797524:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226079104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592916.797557:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226079104:12345-0@lo:400:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592916.797563:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592916.797592:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226079104:0@lo:400:kworker.0 00000100:00100000:3.0:1788592916.797780:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078976 00000100:00100000:3.0:1788592916.797784:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078976 00000100:00100000:3.0:1788592916.797809:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079488 00000100:00100000:3.0:1788592916.797811:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079488 00000100:00100000:3.0:1788592916.797839:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079360 00000100:00100000:3.0:1788592916.797848:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079360 00000100:00100000:3.0:1788592916.797864:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079232 00000100:00100000:3.0:1788592916.797866:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079232 00000100:00100000:3.0:1788592916.797877:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592916.797883:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226078976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592916.797922:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226078976:12345-0@lo:400:kworker.0 Request processed in 40us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592916.797929:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592916.797941:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592916.797948:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226079488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592916.797973:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226079488:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592916.797979:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592916.797989:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592916.797995:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475226079360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592916.798024:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475226079360:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592916.798030:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592916.798039:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788592916.798045:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226079232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592916.798090:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226079232:12345-0@lo:400:kworker.0 Request processed in 45us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592916.798095:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788592916.798128:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f0e00 x1875475226078976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592916.798137:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226078976:0@lo:400:kworker.0 00010000:00080000:3.0:1788592916.798155:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f1880 x1875475226079488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592916.798164:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226079488:0@lo:400:kworker.0 00010000:00080000:3.0:1788592916.798187:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f3800 x1875475226079232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592916.798195:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226079232:0@lo:400:kworker.0 00010000:00080000:3.0:1788592916.798202:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92186b9f3b80 x1875475226079360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592916.798210:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475226079360:0@lo:400:kworker.0 00000100:00100000:0.0:1788592916.798408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226078848:0@lo:8:kworker.0 00000100:00100000:0.0:1788592916.798445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592916.798517:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226078848 00000100:00100000:3.0:1788592916.798522:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226078848 00000100:00100000:3.0:1788592916.798553:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592916.798558:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1875475226078848:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788592916.798577:0:18763:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788592916.799478:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592916.799484:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592916.815451:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1875475226078848:12345-0@lo:8:kworker.0 Request processed in 16884us (16997us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592916.815465:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788592916.815721:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592916.815727:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788592916.815731:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226078848:0@lo:8:kworker.0 00010000:00010000:0.0:1788592917.691521:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592917.816233:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592902/real 1788592902] req@ffff921744774e00 x1875475226070144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592917 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592917.816274:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff921744774e00 x1875475226070144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592917 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592917.816294:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592902/real 1788592902] req@ffff921744774700 x1875475226070272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592917 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592917.816308:0:3638:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff921744774700 x1875475226070272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592917 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788592917.816328:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fc000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592917.816348:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788592917.816352:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226070144:0@lo:8:kworker.0 00000100:00080000:0.0:1788592917.816358:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592917.816363:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788592917.816365:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226070272:0@lo:8:kworker.0 00000100:00080000:3.0:1788592917.816703:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592917.816707:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788592917.816710:0:38:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592917.816715:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:3.0:1788592917.816719:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788592917.816725:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592917.816753:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360c700 x1875475226080000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592917.816794:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592917.816798:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788592917.816799:0:38:0:(import.c:65:import_set_state_nolock()) ffff9218765fc000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592917.816803:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1788592917.816806:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788592917.816810:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9218765fc000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592917.816821:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360f800 x1875475226080384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592917.816829:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592917.816832:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788592917.816833:0:38:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592917.816836:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1788592917.816839:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788592917.816841:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff921875a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:3.0:1788592917.816852:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92174360e680 x1875475226080512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592917.817354:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226079616:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.817421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.817462:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226080256:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.817491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.817515:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788592917.817522:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226080128:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.817556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.817576:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226080896:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.817596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.817625:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080256 00000100:00100000:2.0:1788592917.817633:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080256 00000100:00100000:2.0:1788592917.817678:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592917.817687:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226080256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.817738:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226080256:12345-0@lo:400:kworker.0 Request processed in 53us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.817745:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592917.817797:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226080256:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819489:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226079872:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819549:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.819580:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475226080768:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819606:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.819638:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788592917.819645:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226079744:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.819687:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226080640:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.819752:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079872 00000100:00100000:2.0:1788592917.819759:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079872 00000100:00100000:2.0:1788592917.819818:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592917.819828:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226079872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819874:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226079872:12345-0@lo:400:kworker.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.819890:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592917.819915:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079744 00000100:00100000:2.0:1788592917.819919:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079744 00000100:00100000:2.0:1788592917.819942:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592917.819948:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226079744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.819998:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226079744:12345-0@lo:400:kworker.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.820005:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592917.820027:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226080000:0@lo:8:kworker.0 00000100:00100000:2.0:1788592917.820054:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.820096:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226080384:0@lo:8:kworker.0 00000100:00100000:2.0:1788592917.820125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.820153:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226080512:0@lo:8:kworker.0 00000100:00100000:2.0:1788592917.820179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592917.820205:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080000 00000100:00100000:2.0:1788592917.820208:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080000 00000100:00100000:2.0:1788592917.820222:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080384 00000100:00100000:2.0:1788592917.820226:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080384 00000100:00100000:2.0:1788592917.820234:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080512 00000100:00100000:2.0:1788592917.820236:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080512 00000100:00100000:2.0:1788592917.820246:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592917.820372:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226080000:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788592917.820391:0:18684:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788592917.820426:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226080000:12345-0@lo:8:kworker.0 Request processed in 54us (370us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592917.820432:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592917.820451:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592917.820456:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226080384:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788592917.820474:0:18684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1788592917.820502:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db61a5 00002000:00100000:2.0:1788592917.820514:0:18684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff921743978800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788592917.820518:0:18684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788592917.820521:0:18684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788592917.820593:0:18684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788592917.820616:0:18684:0:(import.c:65:import_set_state_nolock()) ffff921743979000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592917.820648:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875475226080384:12345-0@lo:8:kworker.0 Request processed in 191us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.820655:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592917.820668:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592917.820672:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226080512:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788592917.820682:0:18684:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788592917.820723:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226080512:12345-0@lo:8:kworker.0 Request processed in 49us (543us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592917.820729:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592917.820775:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226079744:0@lo:400:kworker.0 00000100:00100000:2.0:1788592917.820788:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226079872:0@lo:400:kworker.0 00000100:00080000:2.0:1788592917.820820:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592917.820826:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592917.820829:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226080000:0@lo:8:kworker.0 00000100:00100000:2.0:1788592917.820838:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592917.820853:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788592917.820860:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788592917.820865:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788592917.820868:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9218765fc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788592917.820882:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788592917.820887:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226080384:0@lo:8:kworker.0 00000100:00080000:2.0:1788592917.820898:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592917.820902:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592917.820905:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226080512:0@lo:8:kworker.0 00000100:00100000:0.0:1788592917.821375:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080128 00000100:00100000:0.0:1788592917.821382:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080128 00000100:00100000:0.0:1788592917.821407:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080896 00000100:00100000:0.0:1788592917.821410:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080896 00000100:00100000:0.0:1788592917.821421:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080768 00000100:00100000:0.0:1788592917.821423:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080768 00000100:00100000:0.0:1788592917.821433:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226080640 00000100:00100000:0.0:1788592917.821435:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226080640 00000100:00100000:0.0:1788592917.821446:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788592917.821452:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226080128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592917.821502:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875475226080128:12345-0@lo:400:kworker.0 Request processed in 51us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592917.821508:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788592917.821521:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788592917.821527:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226080896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592917.821566:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875475226080896:12345-0@lo:400:kworker.0 Request processed in 40us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592917.821572:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788592917.821585:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592917.821591:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475226080768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592917.821625:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875475226080768:12345-0@lo:400:kworker.0 Request processed in 35us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592917.821631:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592917.821641:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592917.821646:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226080640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592917.821672:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226080640:12345-0@lo:400:kworker.0 Request processed in 26us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592917.821677:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:0.0:1788592917.821724:0:17920:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788592917.821744:0:17920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17920:1875475226081152:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788592917.821789:0:17920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592917.821808:0:17920:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217427810c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788592917.821823:0:17919:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788592917.821894:0:17919:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 452068826614ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788592917.821900:0:17919:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788592917.822064:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592917.822097:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226081024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788592917.822126:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592917.822154:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081024 00000100:00100000:0.0:1788592917.822158:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081024 00000100:00100000:0.0:1788592917.822196:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592917.822209:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875475226081024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592917.822224:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00010000:00080000:2.0:1788592917.822639:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92174360f100 x1875475226080128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592917.822652:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875475226080128:0@lo:400:kworker.0 00010000:00080000:2.0:1788592917.822665:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741dd9f80 x1875475226080896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592917.822673:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1875475226080896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592917.822781:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875475226081024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 571us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592917.822788:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788592917.822808:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592917.822835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226081024:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788592917.822865:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741ddad80 x1875475226080640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592917.822874:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226080640:0@lo:400:kworker.0 00010000:00080000:0.0:1788592917.822902:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921741ddb100 x1875475226080768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592917.822910:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1875475226080768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592917.822932:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081152 00000100:00100000:0.0:1788592917.822936:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081152 00000100:00100000:0.0:1788592917.823447:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592917.823457:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17920:x1875475226081152:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788592917.823805:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226079616 00000100:00100000:3.0:1788592917.823811:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226079616 00000100:00100000:3.0:1788592917.823952:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788592917.823961:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:3642:x1875475226079616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592917.824027:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:3642:x1875475226079616:12345-0@lo:400:kworker.0 Request processed in 68us (6606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592917.824035:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788592917.824407:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:70647b28-81c8-4371-870a-35a99a7dd483:3642:1875475226079616:0@lo:400:kworker.0 00002000:00080000:2.0:1788592917.827105:0:18684:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788592917.827114:0:18684:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788592917.827190:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17920:x1875475226081152:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3732us (5396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.827201:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592917.827310:0:17920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17920:1875475226081152:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788592917.827324:0:17920:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788592917.827363:0:17920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17920:1875475226081280:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788592917.827397:0:17920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592917.827427:0:17920:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592917.827521:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081280 00000100:00100000:2.0:1788592917.827528:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081280 00000100:00100000:2.0:1788592917.827573:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592917.827583:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17920:x1875475226081280:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788592917.827613:0:18682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788592917.827660:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17920:x1875475226081280:12345-0@lo:5:osp-pre-0-1.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.827667:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592917.827799:0:17920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17920:1875475226081280:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788592917.827809:0:17920:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788592917.827835:0:17920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17920:1875475226081408:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788592917.827858:0:17920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592917.827960:0:17920:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592917.830104:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081408 00000100:00100000:2.0:1788592917.830116:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081408 00000100:00100000:2.0:1788592917.830172:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592917.830181:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17920:x1875475226081408:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788592917.830223:0:18763:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1788592917.830772:0:17911:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:0.0:1788592917.849561:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788592917.849578:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788592917.849806:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17920:x1875475226081408:12345-0@lo:5:osp-pre-0-1.0 Request processed in 19622us (21942us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788592917.849817:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592917.849907:0:17920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788592917.849915:0:17920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17920:1875475226081408:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788592917.849930:0:17920:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788592917.850051:0:17920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17920:1875475226081536:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788592917.850213:0:17920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592917.850346:0:17920:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592917.850454:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081536 00000100:00100000:2.0:1788592917.850461:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081536 00000100:00100000:2.0:1788592917.850534:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592917.850543:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17920:x1875475226081536:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788592917.850596:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17920:x1875475226081536:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592917.850603:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788592917.850659:0:17920:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744778a80 x1875475226081536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788592933 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592917.850683:0:17920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17920:1875475226081536:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788592918.716232:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592918.840406:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226081664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592918.840480:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592918.840534:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081664 00000100:00100000:2.0:1788592918.840542:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081664 00000100:00100000:2.0:1788592918.840588:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592918.840598:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226081664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788592918.840632:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788592918.840679:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226081664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592918.840686:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592918.840991:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226081664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592918.841166:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592918.841176:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226081792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592918.841228:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592918.841255:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081792 00000100:00100000:2.0:1788592918.841259:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081792 00000100:00100000:2.0:1788592918.841283:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592918.841291:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226081792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788592918.841311:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788592918.841345:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226081792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592918.841351:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592918.841379:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226081792:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1788592919.636422:0:19497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788592919.636427:0:19497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788592919.636428:0:19497:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788592919.636532:0:19497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff921852d44000 00000020:01000004:2.0:1788592919.636548:0:19497:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788592919.636563:0:19497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788592919.636578:0:19497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff921742498000) 00000020:00000080:2.0:1788592919.636609:0:19497:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788592919.736272:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788592919.748535:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788592919.749128:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788592919.749417:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788592919.750669:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788592919.752048:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788592919.752464:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788592919.752982:0:19497:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788592919.765176:0:19497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788592919.765415:0:19497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788592919.765429:0:19497:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788592919.765441:0:19497:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd314a3362db61b3 00000020:01000004:3.0:1788592919.765447:0:19497:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788592919.765469:0:19497:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.147@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788592919.765472:0:19497:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788592919.765477:0:19497:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788592919.765506:0:19497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788592919.765510:0:19497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.147@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788592919.782261:0:19497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788592919.782302:0:19497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.147@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788592919.782307:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788592919.782308:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788592919.782309:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592919.782311:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592919.782312:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592919.782313:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592919.782315:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592919.782316:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592919.782317:0:19497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592919.782321:0:19497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788592919.782323:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788592919.782324:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788592919.782325:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592919.782327:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592919.782328:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592919.782329:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592919.782330:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592919.782331:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592919.782332:0:19497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788592919.782359:0:19497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788592919.782378:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226081920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788592919.782458:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.782510:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff92174396a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.782544:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226081920 00000100:00100000:2.0:1788592919.782552:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226081920 00000100:00100000:2.0:1788592919.782611:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788592919.782622:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:19497:x1875475226081920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788592919.782650:0:17172:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788592919.782654:0:17172:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788592919.782658:0:17172:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788592919.783379:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:19497:x1875475226081920:12345-0@lo:253:mount.lustre.0 Request processed in 759us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.783390:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788592919.783537:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226081920:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788592919.783548:0:19497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788592919.783551:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788592919.783553:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788592919.783554:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592919.783555:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592919.783555:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592919.783556:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592919.783558:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592919.783559:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592919.783560:0:19497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788592919.783580:0:19497:0:(tgt_mount.c:101:server_register_mount()) register mount ffff921852d44000 from lustre-OST0001 10000000:01000000:3.0:1788592919.783605:0:19497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788592919.783608:0:19497:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788592919.783616:0:19497:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92174350b380 local copy 00010000:00010000:3.0:1788592919.783625:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592919.783713:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592919.783743:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.783786:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87540 going to sleep for 11 seconds 00000100:00100000:0.0:1788592919.783856:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082048 00000100:00100000:0.0:1788592919.783862:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082048 00000100:00100000:0.0:1788592919.783901:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788592919.783909:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:19497:x1875475226082048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592919.784061:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+21:19497:x1875475226082048:12345-0@lo:501:mount.lustre.0 Request processed in 153us (316us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592919.784105:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788592919.788801:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788592919.788857:0:19497:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788592919.788907:0:19497:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788592919.788917:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592919.788928:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205ea00/0xbd314a3362db5e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db5e09 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592919.788971:0:19497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff921852d44000 10000000:01000000:1.0:1788592919.788991:0:19497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788592919.788999:0:19497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788592919.789002:0:19497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592919.789006:0:19497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788592919.789009:0:19497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788592919.789045:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592919.789054:0:19497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592919.789064:0:19497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592919.789101:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788592919.789164:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.789530:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21540 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.789863:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082176 00000100:00100000:2.0:1788592919.789871:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082176 00000100:00100000:2.0:1788592919.790455:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788592919.790468:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+21:19497:x1875475226082176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592919.790485:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592919.790501:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80e00/0xbd314a3362db61c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db61ba expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.790528:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80e00/0xbd314a3362db61c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db61ba expref: 22 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.790540:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80e00/0xbd314a3362db61c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db61ba expref: 22 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.790652:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80e00, rc 0) 00000100:00100000:2.0:1788592919.790706:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082176:12345-0@lo:101:mount.lustre.0 Request processed in 241us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.790713:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788592919.790812:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592919.790828:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61c1 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592919.790837:0:19497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db61c1 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592919.792203:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788592919.795611:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592919.800447:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788592919.800506:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788592919.800524:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788592919.800538:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788592919.800551:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788592919.800564:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788592919.800593:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788592919.800600:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788592919.800713:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592919.800794:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.800843:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592919.800953:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082304 00000100:00100000:3.0:1788592919.800962:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082304 00000100:00100000:3.0:1788592919.801030:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788592919.801041:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592919.801231:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082304:12345-0@lo:501:mount.lustre.0 Request processed in 192us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592919.801240:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788592919.801491:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592919.801528:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592919.801571:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.801598:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.801648:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082432 00000100:00100000:2.0:1788592919.801659:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082432 00000100:00100000:2.0:1788592919.801699:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788592919.801710:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592919.807975:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082432:12345-0@lo:503:mount.lustre.0 Request processed in 6260us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.807989:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788592919.808420:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082432:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788592919.809179:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592919.809486:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592919.809547:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592919.809593:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.810179:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082560 00000100:00100000:2.0:1788592919.810188:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082560 00000100:00100000:2.0:1788592919.810299:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788592919.810310:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592919.812213:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082560:12345-0@lo:502:mount.lustre.0 Request processed in 1898us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.812227:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788592919.812358:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592919.812611:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788592919.812639:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788592919.812651:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788592919.812663:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788592919.812675:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788592919.812689:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788592919.812703:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788592919.812729:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788592919.812743:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788592919.812785:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592919.812831:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592919.813490:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592919.817855:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082688 00000100:00100000:3.0:1788592919.817870:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082688 00000100:00100000:3.0:1788592919.817933:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788592919.817958:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.822815:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082688:12345-0@lo:502:mount.lustre.0 Request processed in 4851us (9976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592919.822830:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788592919.823042:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592919.823163:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788592919.823176:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788592919.826157:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592919.826169:0:19501:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788592919.826175:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592919.826177:0:19501:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788592919.826183:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592919.826198:0:19501:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92174249b380) 00000020:00000080:2.0:1788592919.826223:0:19501:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788592919.826229:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788592919.826448:0:19501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921852d44000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788592919.826460:0:19501:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788592919.826470:0:19501:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd314a3362db61cf 00010000:00010000:2.0:1788592919.834522:0:19501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788592919.834955:0:19501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788592919.838655:0:19501:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788592919.839993:0:19501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788592919.840005:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592919.840030:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592919.840032:0:19501:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788592919.840037:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592919.840042:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592919.840043:0:19501:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788592919.840046:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788592919.840048:0:19501:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788592919.840050:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592919.840052:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592919.840054:0:19501:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788592919.840056:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592919.840058:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592919.840060:0:19501:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788592919.840062:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788592919.844244:0:19501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592919.844257:0:19501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592919.844259:0:19501:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788592919.844265:0:19501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788592919.844852:0:19497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788592919.844896:0:19497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788592919.844914:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61c1 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.844926:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185022a400/0xbd314a3362db61ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61c1 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592919.844934:0:19497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921852d44000 from 1 10000000:01000000:3.0:1788592919.844937:0:19497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592919.844975:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.844982:0:19497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.844992:0:19497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592919.845017:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592919.845722:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.845812:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.845912:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082816 00000100:00100000:2.0:1788592919.845920:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082816 00000100:00100000:2.0:1788592919.845973:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788592919.845982:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:19497:x1875475226082816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592919.845995:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592919.846009:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db61d6 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.846656:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.846669:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.846678:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80800, rc 0) 00000100:00100000:2.0:1788592919.846869:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226082816:12345-0@lo:101:mount.lustre.0 Request processed in 887us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.846876:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788592919.846949:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592919.846965:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.846982:0:19497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592919.851400:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788592919.851673:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592919.851881:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788592919.851905:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788592919.851922:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788592919.851926:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788592919.851992:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592919.852301:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.852421:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592919.853294:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226082944 00000100:00100000:0.0:1788592919.853303:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226082944 00000100:00100000:0.0:1788592919.853385:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788592919.853395:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226082944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592919.853561:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226082944:12345-0@lo:501:mount.lustre.0 Request processed in 166us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592919.853570:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592919.853685:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226082944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592919.853726:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592919.853782:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.854780:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592919.857246:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083072 00000100:00100000:1.0:1788592919.857260:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083072 00000100:00100000:1.0:1788592919.857329:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788592919.857340:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592919.857619:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083072:12345-0@lo:503:mount.lustre.0 Request processed in 280us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592919.857628:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788592919.858266:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788592919.859308:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592919.859393:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.859455:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.859501:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592919.859824:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083200 00000100:00100000:1.0:1788592919.859830:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083200 00000100:00100000:1.0:1788592919.859876:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788592919.859885:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788592919.859992:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083200:12345-0@lo:502:mount.lustre.0 Request processed in 108us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592919.860000:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788592919.860238:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592919.860419:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788592919.860447:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788592919.860462:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788592919.860625:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788592919.860644:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788592919.860657:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788592919.860670:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788592919.860683:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788592919.860695:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788592919.860792:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788592919.860808:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788592919.860837:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.860882:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.860959:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.865020:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083328 00000100:00100000:2.0:1788592919.865039:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083328 00000100:00100000:3.0:1788592919.865164:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788592919.865176:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.865373:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083328:12345-0@lo:502:mount.lustre.0 Request processed in 198us (4489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592919.865380:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788592919.865817:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592919.865909:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788592919.865923:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788592919.866915:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592919.866926:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.866928:0:19505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592919.866934:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff921852d44000 00000020:00000080:0.0:1788592919.866936:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592919.866944:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592919.866946:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.866947:0:19505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788592919.866949:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592919.866952:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.866962:0:19505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592919.866966:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff921852d44000 00000020:00000080:0.0:1788592919.866968:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592919.867034:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592919.867038:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.867040:0:19505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788592919.867042:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592919.867045:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.867046:0:19505:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592919.867049:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff921852d44000 00000020:00000080:0.0:1788592919.867051:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592919.867139:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592919.867143:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.867145:0:19505:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788592919.867148:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592919.867150:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.867151:0:19505:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788592919.867154:0:19505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff921852d44000 00000020:00000080:0.0:1788592919.867157:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592919.867180:0:19505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592919.867183:0:19505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592919.867185:0:19505:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788592919.867188:0:19505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788592919.873211:0:19497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788592919.873267:0:19497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592919.873289:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.873302:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592919.873369:0:19497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788592919.873372:0:19497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff921852d44000 10000000:01000000:3.0:1788592919.873376:0:19497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff921852d44000 10000000:01000000:3.0:1788592919.873379:0:19497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592919.873386:0:19497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff921852d44000 from 1 10000000:01000000:3.0:1788592919.873395:0:19497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788592919.873434:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.873443:0:19497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.873454:0:19497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592919.873479:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592919.874197:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.875236:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87840 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.880358:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083456 00000100:00100000:2.0:1788592919.880373:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083456 00000100:00100000:2.0:1788592919.880492:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788592919.881625:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+23:19497:x1875475226083456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592919.881643:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592919.881660:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80000/0xbd314a3362db61eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db61e4 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.881688:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80000/0xbd314a3362db61eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db61e4 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.881699:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80000/0xbd314a3362db61eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db61e4 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.881708:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80000, rc 0) 00000100:00100000:2.0:1788592919.881788:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083456:12345-0@lo:101:mount.lustre.0 Request processed in 174us (7592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.881796:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788592919.888142:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592919.888172:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61eb expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.888263:0:19497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db61eb expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592919.890648:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788592919.890934:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592919.891142:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788592919.891184:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788592919.891199:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788592919.891212:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788592919.891242:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788592919.891258:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788592919.891271:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788592919.891284:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788592919.891309:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788592919.891324:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788592919.891339:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788592919.891353:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788592919.891367:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788592919.891383:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788592919.891399:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788592919.891413:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788592919.891425:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788592919.891438:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788592919.891451:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788592919.891465:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788592919.891710:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788592919.891744:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788592919.891777:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788592919.891791:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788592919.891804:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788592919.891821:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788592919.891838:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788592919.891857:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788592919.891877:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788592919.891895:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788592919.891916:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788592919.891936:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788592919.891955:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788592919.891970:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788592919.891982:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788592919.891996:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788592919.892025:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788592919.892042:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788592919.892054:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788592919.892091:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788592919.892108:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788592919.892132:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788592919.892145:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788592919.894326:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788592919.894355:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788592919.894367:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788592919.894396:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788592919.894402:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788592919.895274:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592919.895342:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592919.895384:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.895825:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083584 00000100:00100000:2.0:1788592919.895833:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083584 00000100:00100000:2.0:1788592919.895892:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788592919.895902:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592919.896037:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083584:12345-0@lo:501:mount.lustre.0 Request processed in 137us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.896055:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788592919.896149:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592919.896618:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592919.896665:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.896684:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218472ad540 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.896704:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083712 00000100:00100000:2.0:1788592919.896709:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083712 00000100:00100000:2.0:1788592919.896739:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788592919.896745:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592919.896838:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083712:12345-0@lo:503:mount.lustre.0 Request processed in 93us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.896845:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788592919.896888:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083712:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788592919.898477:0:19497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592919.899846:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592919.899926:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.899964:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921743975000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.899998:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083840 00000100:00100000:2.0:1788592919.900004:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083840 00000100:00100000:2.0:1788592919.900055:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788592919.900083:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592919.902408:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083840:12345-0@lo:502:mount.lustre.0 Request processed in 2337us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.902421:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788592919.902740:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592919.902976:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788592919.903010:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788592919.903024:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788592919.903038:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788592919.903052:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788592919.903095:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788592919.903114:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788592919.903143:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788592919.904687:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788592919.904712:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788592919.904727:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788592919.904741:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788592919.904770:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788592919.904785:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788592919.904798:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788592919.904812:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788592919.904825:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788592919.904839:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788592919.904851:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788592919.904864:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788592919.904878:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788592919.904892:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788592919.904908:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788592919.904943:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788592919.904961:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788592919.904975:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788592919.904987:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788592919.905000:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788592919.905013:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788592919.907294:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788592919.907340:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788592919.907367:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788592919.907382:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788592919.907394:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788592919.907405:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788592919.907418:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788592919.907431:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788592919.907445:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788592919.907460:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788592919.911288:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788592919.911341:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788592919.911359:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788592919.911376:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788592919.911392:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788592919.911407:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788592919.911424:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788592919.911447:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788592919.911465:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788592919.911739:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.911840:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.911884:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592919.911911:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226083968 00000100:00100000:3.0:1788592919.911919:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226083968 00000100:00100000:3.0:1788592919.911971:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788592919.911982:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.912145:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226083968:12345-0@lo:502:mount.lustre.0 Request processed in 165us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592919.912152:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788592919.912230:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226083968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592919.912410:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788592919.912435:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788592919.912458:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226084096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.912494:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.920231:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084096 00000100:00100000:2.0:1788592919.920246:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084096 00000100:00100000:2.0:1788592919.920303:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592919.920313:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226084096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592919.922646:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87840 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.931298:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226084096:12345-0@lo:502:mount.lustre.0 Request processed in 10977us (18794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.931315:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788592919.933690:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226084096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592919.933830:0:19497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788592919.933844:0:19497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788592919.935784:0:19511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788592919.935802:0:19511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff921850ee4d40) 00000020:00000080:0.0:1788592919.935828:0:19511:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788592919.935921:0:19511:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921852d44000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788592919.935925:0:19511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921852d44000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788592919.935928:0:19511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921852d44000 3 00010000:00080000:0.0:1788592919.935957:0:19511:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92174460c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1788592919.938699:0:19511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788592919.938910:0:19511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788592919.938952:0:19511:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788592919.938964:0:19511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbd314a3362db61f9 00000100:00080000:0.0:1788592919.938973:0:19511:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592919.938979:0:19511:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92174460c000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592919.939012:0:19511:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744779180 x1875475226084224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788592919.940349:0:19511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788592919.940485:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226084224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788592919.940555:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.940786:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084224 00000100:00100000:2.0:1788592919.940794:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084224 00000100:00100000:2.0:1788592919.940833:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592919.940841:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226084224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788592919.940867:0:17180:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1788592919.940898:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbd314a3362db6200 00000004:00100000:2.0:1788592919.940912:0:17180:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592919.940944:0:17180:0:(import.c:65:import_set_state_nolock()) ffff921744694000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592919.940993:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875475226084224:12345-0@lo:38:llog_process_th.0 Request processed in 151us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.941000:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788592919.941465:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744779180 x1875475226084224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592919.941477:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592919.941484:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788592919.941491:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788592919.941496:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788592919.941498:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92174460c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788592919.941504:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1875475226084224:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788592919.942232:0:19511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788592919.942248:0:19511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff921850ee19c0) 00000020:00000080:0.0:1788592919.942269:0:19511:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788592919.942359:0:19511:0:(tgt_mount.c:153:server_get_mount()) get mount ffff921852d44000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788592919.942363:0:19511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff921852d44000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788592919.942366:0:19511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff921852d44000 3 00010000:00080000:0.0:1788592919.942393:0:19511:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92174460e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.147@tcp at head 00010000:00010000:0.0:1788592919.943951:0:19511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788592919.945694:0:19511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788592919.945741:0:19511:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000100:00080000:1.0:1788592919.951091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592919.951098:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592919.951102:0:8:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592919.951109:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788592919.951114:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788592919.951120:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592919.951142:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744555500 x1875475226084608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592919.951289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592919.951293:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592919.951294:0:8:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592919.951298:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788592919.951301:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788592919.951314:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff921875a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592919.951327:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9217444c4a80 x1875475226085120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592919.951378:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226084352:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951445:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951477:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226084992:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951620:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951645:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788592919.951651:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226084480:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951672:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951689:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226085248:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951717:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951766:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226084608:0@lo:8:kworker.0 00000100:00100000:1.0:1788592919.951793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951809:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226085120:0@lo:8:kworker.0 00000100:00100000:1.0:1788592919.951827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951852:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226084736:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951874:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951888:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226085376:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951910:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951928:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788592919.951932:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226084864:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.951971:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592919.951989:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226085504:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.952018:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.952179:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084992 00000100:00100000:2.0:1788592919.952187:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084992 00000100:00100000:2.0:1788592919.952236:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084480 00000100:00100000:2.0:1788592919.952239:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084480 00000100:00100000:2.0:1788592919.952252:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084608 00000100:00100000:2.0:1788592919.952255:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084608 00000100:00100000:2.0:1788592919.952264:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085120 00000100:00100000:2.0:1788592919.952266:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085120 00000100:00100000:2.0:1788592919.952278:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592919.952287:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226084992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592919.952463:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226084992:12345-0@lo:400:kworker.0 Request processed in 176us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.952471:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592919.952487:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592919.952494:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226084480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592919.952522:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226084480:12345-0@lo:400:kworker.0 Request processed in 29us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.952528:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592919.952539:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592919.952550:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226084608:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788592919.952598:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226084608:12345-0@lo:8:kworker.0 Request processed in 47us (803us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788592919.952604:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592919.952616:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592919.952619:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226085120:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788592919.952639:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085248 00000100:00100000:1.0:1788592919.952643:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085248 00000100:00100000:2.0:1788592919.952648:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1875475226085120:12345-0@lo:8:kworker.0 Request processed in 28us (821us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788592919.952654:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788592919.952663:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084736 00000100:00100000:1.0:1788592919.952666:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084736 00000100:00100000:2.0:1788592919.952675:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084352 00000100:00100000:1.0:1788592919.952676:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085376 00000100:00100000:2.0:1788592919.952678:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084352 00000100:00100000:1.0:1788592919.952678:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085376 00000100:00100000:1.0:1788592919.952689:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085504 00000100:00100000:2.0:1788592919.952692:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226084864 00000100:00100000:1.0:1788592919.952692:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085504 00000100:00100000:2.0:1788592919.952694:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226084864 00000100:00100000:2.0:1788592919.952705:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592919.952706:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592919.952711:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226084352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.952711:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226085248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592919.952740:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226084352:12345-0@lo:400:kworker.0 Request processed in 29us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592919.952740:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226085248:12345-0@lo:400:kworker.0 Request processed in 28us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.952747:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592919.952747:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592919.952771:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592919.952773:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592919.952777:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226084864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.952777:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226084736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592919.952807:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226084864:12345-0@lo:400:kworker.0 Request processed in 30us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.952813:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788592919.952832:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592919.952835:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592919.952837:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592919.952866:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592919.952876:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226085376:12345-0@lo:400:kworker.0 00000020:00000080:0.0:1788592919.952953:0:19511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbd314a3362db620e 00000100:00080000:0.0:1788592919.952963:0:19511:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592919.952967:0:19511:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff92174460e000 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:0.0:1788592919.952989:0:19511:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744779180 x1875475226085632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788592919.953002:0:19511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788592919.955213:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1875475226085632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788592919.955286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592919.955338:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592919.955346:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592919.955350:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788592919.955354:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226084608:0@lo:8:kworker.0 00000100:00100000:0.0:1788592919.955370:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592919.955374:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592919.955377:0:3638:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788592919.955379:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226085120:0@lo:8:kworker.0 00000100:00100000:0.0:1788592919.955443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226084480:0@lo:400:kworker.0 00010000:00080000:0.0:1788592919.955458:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9217444c7b80 x1875475226085248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592919.955468:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226085248:0@lo:400:kworker.0 00000100:00100000:0.0:1788592919.955480:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226084352:0@lo:400:kworker.0 00000100:00100000:0.0:1788592919.955491:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226084992:0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.956630:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226084736:12345-0@lo:400:kworker.0 Request processed in 3844us (4748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592919.956643:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788592919.956672:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085632 00000100:00100000:1.0:1788592919.956679:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085632 00000100:00100000:1.0:1788592919.956704:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592919.956715:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226085504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592919.956786:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226085504:12345-0@lo:400:kworker.0 Request processed in 75us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592919.956792:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592919.956806:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788592919.956810:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875475226085632:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788592919.956846:0:17180:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:1.0:1788592919.956881:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbd314a3362db6215 00000004:00100000:1.0:1788592919.956894:0:17180:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788592919.956925:0:17180:0:(import.c:65:import_set_state_nolock()) ffff9217444dd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592919.956974:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875475226085632:12345-0@lo:38:llog_process_th.0 Request processed in 162us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592919.956981:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788592919.957130:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744779180 x1875475226085632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592919.957140:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592919.957147:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788592919.957167:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788592919.957171:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788592919.957173:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92174460e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788592919.957178:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1875475226085632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592919.957626:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226084864:0@lo:400:kworker.0 00010000:00080000:1.0:1788592919.957645:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9217444c6d80 x1875475226085504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592919.957655:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226085504:0@lo:400:kworker.0 00010000:00080000:1.0:1788592919.957666:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff921744557800 x1875475226084736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592919.957672:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226084736:0@lo:400:kworker.0 00000100:00100000:3.0:1788592919.958345:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226085376:12345-0@lo:400:kworker.0 Request processed in 5467us (6430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592919.958355:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:3.0:1788592919.958522:0:19511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788592919.958838:0:19497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788592919.958870:0:19497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592919.958895:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61eb expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592919.958906:0:19497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92188205f000/0xbd314a3362db61e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db61eb expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592919.958955:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592919.958957:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592919.958963:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592919.958964:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592919.958965:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592919.958966:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592919.958967:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592919.958969:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592919.958970:0:19497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592919.958974:0:19497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788592919.958976:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592919.958977:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592919.958978:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592919.958979:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592919.958980:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592919.958981:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592919.958981:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592919.958982:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592919.958983:0:19497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592919.959007:0:19497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788592919.959035:0:19497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226085760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788592919.959328:0:19497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592919.959369:0:19497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218512f16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592919.959403:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085760 00000100:00100000:2.0:1788592919.959410:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085760 00000100:00100000:2.0:1788592919.959461:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788592919.959469:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226085760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788592919.959498:0:17174:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788592919.959513:0:17174:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788592919.971872:0:17174:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788592919.971890:0:17174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788592919.972098:0:17195:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592919.972103:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592919.972127:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.972146:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6189 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.972178:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6197 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.972185:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.972221:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db6197 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592919.972232:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+24:19497:x1875475226085760:12345-0@lo:253:mount.lustre.0 Request processed in 12763us (12902us total) trans 0 rc 0/0 00010000:00010000:3.0:1788592919.972234:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db6197 expref: 24 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592919.972243:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788592919.972246:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226085888:0@lo:104: 00000100:00100000:3.0:1788592919.972282:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592919.972321:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db6189 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.972330:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db6189 expref: 23 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592919.972338:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226086016:0@lo:104: 00000100:00100000:3.0:1788592919.972360:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592919.972379:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff921875a87900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592919.972397:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226085888 00000100:00100000:3.0:1788592919.972403:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226085888 00000100:00100000:2.0:1788592919.972404:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086016 00000100:00100000:2.0:1788592919.972407:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086016 00000100:00100000:2.0:1788592919.972435:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592919.972443:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:17195:x1875475226086016:12345-0@lo:104: 00010000:00010000:2.0:1788592919.972455:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.972499:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592919.972505:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+4:17195:x1875475226086016:12345-0@lo:104: Request processed in 64us (145us total) trans 0 rc 0/0 00010000:00080000:1.0:1788592919.972641:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9217444c6a00 x1875475226085376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592919.972655:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226085376:0@lo:400:kworker.0 00000100:00100000:0.0:1788592919.972876:0:19497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:70647b28-81c8-4371-870a-35a99a7dd483:19497:1875475226085760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788592919.972889:0:19497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788592919.972892:0:19497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592919.972893:0:19497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788592919.972894:0:19497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592919.972895:0:19497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592919.972896:0:19497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592919.972898:0:19497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592919.972899:0:19497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592919.972901:0:19497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592919.972902:0:19497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788592919.972916:0:19497:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788592919.974144:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226086016:0@lo:104: 00000100:00100000:2.0:1788592919.976058:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592919.976116:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592919.976131:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226085888:12345-0@lo:104: 00010000:00010000:2.0:1788592919.976150:0:17164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976244:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592919.976250:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:70647b28-81c8-4371-870a-35a99a7dd483+3:17195:x1875475226085888:12345-0@lo:104: Request processed in 127us (3968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.976269:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788592919.976273:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17195:1875475226085888:0@lo:104: 00010000:00010000:2.0:1788592919.976289:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592919.976295:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592919.976296:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976303:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e400 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592919.976307:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976315:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592919.976322:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592919.976328:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592919.976373:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976380:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592919.976401:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976407:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205e400/0xbd314a3362db6189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6190 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976420:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592919.976423:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976438:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:2.0:1788592919.976441:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976448:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592919.976454:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592919.976460:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592919.976473:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976478:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592919.976484:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976490:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff9217439f0e00/0xbd314a3362db6197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db619e expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.976505:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592919.976507:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592919.976508:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592919.976529:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226086144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592919.976861:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.976900:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592919.976905:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226086272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592919.976934:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592919.976958:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086144 00000100:00100000:2.0:1788592919.976964:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086144 00010000:00010000:2.0:1788592919.976988:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6189 expref: 24 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592919.977008:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086272 00000100:00100000:2.0:1788592919.977010:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086272 00010000:00010000:2.0:1788592919.977663:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6197 expref: 25 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592919.977682:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592919.977689:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+25:3641:x1875475226086144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592919.977713:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592919.977718:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6189 expref: 25 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.977727:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db6189 expref: 25 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.977742:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b81000/0xbd314a3362db6190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db6189 expref: 25 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.977765:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592919.978016:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226086144:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.978037:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592919.978053:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592919.978059:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+23:3641:x1875475226086272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592919.978090:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592919.978094:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6197 expref: 23 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978103:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db6197 expref: 23 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978113:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b81200/0xbd314a3362db619e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db6197 expref: 23 pid: 17172 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978124:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978132:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592919.978145:0:17167:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010406516s 00010000:00010000:2.0:1788592919.978150:0:17167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978157:0:17167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978165:0:17167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978172:0:17167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978177:0:17167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592919.978181:0:17167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978194:0:17167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978207:0:17167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.978216:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592919.978237:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+22:3641:x1875475226086272:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592919.978243:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788592919.979212:0:17195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.979224:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592919.979231:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92188205e600/0xbd314a3362db621c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592919.983176:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592919.996443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226086144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592919.998105:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226086272:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788592920.005708:0:19497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788592920.022353:0:19497:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788592920.022364:0:19497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788592920.022400:0:19497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592920.022449:0:19497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592920.022484:0:19497:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788592920.022512:0:19497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788592920.027097:0:19497:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788592920.027362:0:19497:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788592920.763041:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788592921.081882:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788592921.081889:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9218758fa000 from 10 10000000:01000000:2.0:1788592921.081894:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592921.081946:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592921.081958:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592921.081990:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592921.082016:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592921.082103:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592921.082149:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592921.082518:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086400 00000100:00100000:0.0:1788592921.082526:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086400 00000100:00100000:0.0:1788592921.082601:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788592921.082610:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226086400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592921.082632:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592921.082646:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0400/0xbd314a3362db622a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6223 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.082669:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0400/0xbd314a3362db622a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6223 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.082680:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0400/0xbd314a3362db622a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6223 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.082689:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0400, rc 0) 00000100:00100000:0.0:1788592921.082737:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226086400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592921.082754:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788592921.083218:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592921.083235:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db622a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592921.083245:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db622a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592921.083298:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788592921.083335:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592921.083358:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218469036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592921.083417:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086528 00000100:00100000:0.0:1788592921.083422:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086528 00000100:00100000:0.0:1788592921.083454:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788592921.083462:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226086528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788592921.083475:0:17174:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592921.083491:0:17174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592921.083495:0:17174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788592921.083582:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226086528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592921.083595:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788592921.083671:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788592921.083736:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592921.083753:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db622a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592921.083772:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b81000/0xbd314a3362db6223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db622a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592921.083782:0:17177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788592921.083784:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92174444b000 from 10 10000000:01000000:1.0:1788592921.083787:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788592921.083806:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592921.083814:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592921.083824:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592921.083838:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592921.083867:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592921.083930:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92187edae600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592921.084090:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086656 00000100:00100000:0.0:1788592921.084095:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086656 00000100:00100000:0.0:1788592921.084125:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788592921.084131:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226086656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592921.084140:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592921.084151:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0a00/0xbd314a3362db6238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db6231 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.084169:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0a00/0xbd314a3362db6238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db6231 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.084179:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0a00/0xbd314a3362db6238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6231 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.084187:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0a00, rc 0) 00000100:00100000:0.0:1788592921.084216:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226086656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592921.084221:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788592921.084251:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592921.084263:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6238 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.084271:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db6238 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592921.084318:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788592921.084349:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592921.084362:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218512f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592921.084372:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086784 00000100:00100000:0.0:1788592921.084376:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086784 00000100:00100000:0.0:1788592921.084390:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788592921.084396:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226086784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788592921.084405:0:17175:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592921.084416:0:17175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592921.084419:0:17175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788592921.084482:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226086784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592921.084489:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788592921.084517:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226086784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788592921.084556:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788592921.084562:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6238 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592921.084570:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185022aa00/0xbd314a3362db6231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db6238 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1788592921.084867:0:19564:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788592921.085227:0:19564:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788592921.786182:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592921.914370:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226086912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592921.914444:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592921.915117:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226086912 00000100:00100000:0.0:1788592921.915443:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226086912 00000100:00100000:0.0:1788592921.915543:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592921.915554:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226086912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592921.915623:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788592921.915709:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226086912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592921.915767:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788592921.916316:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592921.916376:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226086912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788592922.812791:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592922.938439:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592922.938462:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226087040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788592922.938534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592922.938690:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087040 00000100:00100000:0.0:1788592922.938699:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087040 00000100:00100000:0.0:1788592922.938771:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592922.938781:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226087040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592922.938803:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788592922.938852:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226087040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592922.938859:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592922.938907:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226087040:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788592922.941226:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788592923.193681:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788592923.836033:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592923.960367:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592923.960390:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226087168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592923.960481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592923.960530:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087168 00000100:00100000:3.0:1788592923.960538:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087168 00000100:00100000:3.0:1788592923.960610:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592923.960621:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226087168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592923.960671:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788592923.960739:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226087168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592923.960746:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592923.960788:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226087168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592923.961245:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592923.961481:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226087296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592923.961521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592923.961914:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087296 00000100:00100000:3.0:1788592923.961921:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087296 00000100:00100000:3.0:1788592923.962030:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592923.962039:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226087296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788592923.962082:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788592923.962214:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226087296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592923.962221:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592923.962307:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226087296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788592924.856463:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592924.985037:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592924.985044:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592924.985056:0:38:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592924.985089:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92187c937800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592924.985110:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9217444c5c00 x1875475226087808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592924.985144:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592924.985147:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592924.985148:0:38:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592924.985153:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff921875a98800 using connection 192.168.203.147@tcp/0@lo 00000100:00100000:1.0:1788592924.985162:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff921744466a00 x1875475226088320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592924.985206:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226087424:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.985211:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226087808:0@lo:8:kworker.0 00000100:00100000:1.0:1788592924.985270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.985270:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985314:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226088064:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985365:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226088704:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985427:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788592924.985433:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226087552:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985765:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985787:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226088192:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985819:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985836:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226088832:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985889:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226087680:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985949:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226088448:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.985969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.985981:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226088960:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.986001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.986121:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226088320:0@lo:8:kworker.0 00000100:00100000:1.0:1788592924.986757:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788592924.986768:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226087936:0@lo:400:kworker.0 00000100:00100000:2.0:1788592924.987158:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088704 00000100:00100000:2.0:1788592924.987167:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088704 00000100:00100000:2.0:1788592924.987369:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088832 00000100:00100000:2.0:1788592924.987374:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088832 00000100:00100000:2.0:1788592924.987392:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088448 00000100:00100000:2.0:1788592924.987395:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088448 00000100:00100000:2.0:1788592924.987405:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088960 00000100:00100000:2.0:1788592924.987407:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088960 00000100:00100000:2.0:1788592924.987421:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592924.987429:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226088704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.987586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.987659:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087424 00000100:00100000:0.0:1788592924.987663:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087424 00000100:00100000:0.0:1788592924.987694:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788592924.987701:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3639:x1875475226087424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.987753:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3639:x1875475226087424:12345-0@lo:400:kworker.0 Request processed in 52us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.987776:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788592924.987820:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087808 00000100:00100000:0.0:1788592924.987824:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087808 00000100:00100000:0.0:1788592924.987835:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088192 00000100:00100000:0.0:1788592924.987837:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088192 00000100:00100000:0.0:1788592924.987852:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087680 00000100:00100000:0.0:1788592924.987855:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087680 00000100:00100000:0.0:1788592924.987864:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088320 00000100:00100000:0.0:1788592924.987867:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088320 00000100:00100000:0.0:1788592924.987875:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592924.987881:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226088192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.987911:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226088192:12345-0@lo:400:kworker.0 Request processed in 30us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.987917:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592924.987927:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592924.987932:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226087680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.987957:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226087680:12345-0@lo:400:kworker.0 Request processed in 25us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.987962:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592924.987972:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592924.987976:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226087808:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788592924.988001:0:18682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1788592924.988028:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd314a3362db623f 00002000:00100000:0.0:1788592924.988042:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92187c416000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788592924.988046:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788592924.988048:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788592924.988315:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788592924.988338:0:18682:0:(import.c:65:import_set_state_nolock()) ffff92187c412800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592924.988378:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875475226087808:12345-0@lo:8:kworker.0 Request processed in 401us (3109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.988384:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592924.988396:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592924.988401:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1875475226088320:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788592924.988415:0:18682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1788592924.988430:0:18682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd314a3362db6246 00002000:00100000:0.0:1788592924.988437:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff92187c417000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788592924.988440:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788592924.988442:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788592924.988463:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788592924.988474:0:18682:0:(import.c:65:import_set_state_nolock()) ffff92187c414000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788592924.988482:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592924.988493:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592924.988495:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788592924.988501:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875475226088320:12345-0@lo:8:kworker.0 Request processed in 99us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.988506:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788592924.988539:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217444c5c00 x1875475226087808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788592924.988554:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788592924.988562:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788592924.988567:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788592924.988569:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92187c937800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788592924.988597:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788592924.988603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1875475226087808:0@lo:8:kworker.0 00010000:00080000:0.0:1788592924.988617:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744466a00 x1875475226088320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788592924.988633:0:3638:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788592924.988638:0:3638:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788592924.988641:0:3638:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788592924.988643:0:3638:0:(import.c:65:import_set_state_nolock()) ffff921875a98800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788592924.988656:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788592924.988660:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1875475226088320:0@lo:8:kworker.0 00000004:00080000:0.0:1788592924.988695:0:17921:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788592924.988764:0:17921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 459235696621ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788592924.988771:0:17921:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788592924.988942:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226088192:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.988953:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226087424:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.989007:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088064 00000100:00100000:0.0:1788592924.989012:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088064 00000100:00100000:0.0:1788592924.989034:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087552 00000100:00100000:0.0:1788592924.989037:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087552 00000100:00100000:0.0:1788592924.989050:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592924.989056:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226088064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.989152:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226088064:12345-0@lo:400:kworker.0 Request processed in 95us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.989158:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592924.989171:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788592924.989177:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226087552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.989204:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226087552:12345-0@lo:400:kworker.0 Request processed in 28us (3440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.989210:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788592924.989263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.989342:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226088576:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.989395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226087680:0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989430:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226087936 00000100:00100000:1.0:1788592924.989434:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226087936 00000100:00100000:1.0:1788592924.989521:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226088576 00000100:00100000:1.0:1788592924.989525:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226088576 00000100:00100000:1.0:1788592924.989656:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592924.989664:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226088832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989697:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226088832:12345-0@lo:400:kworker.0 Request processed in 34us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592924.989702:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592924.989773:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788592924.989790:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226088448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989827:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226088448:12345-0@lo:400:kworker.0 Request processed in 40us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592924.989833:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788592924.989844:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592924.989850:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226088960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989878:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226088960:12345-0@lo:400:kworker.0 Request processed in 28us (3876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592924.989883:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788592924.989894:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592924.989899:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226087936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989923:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226087936:12345-0@lo:400:kworker.0 Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592924.989929:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592924.989940:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788592924.989946:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226088576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592924.989970:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226088576:12345-0@lo:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592924.989976:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:1.0:1788592924.990027:0:17922:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788592924.990047:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744464380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17922:1875475226089216:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788592924.990097:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.990115:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff92187edaee40 going to sleep for 11 seconds 00000100:00080000:1.0:1788592924.990125:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592924.990135:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089216 00000100:00100000:1.0:1788592924.990145:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089216 00000004:00080000:3.0:1788592924.991192:0:17206:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788592924.991214:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17206:1875475226089472:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788592924.991268:0:17206:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592924.991279:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089472 00000100:00100000:3.0:1788592924.991287:0:17206:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218512f10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592924.991352:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089472 00000100:00100000:1.0:1788592924.991384:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788592924.991391:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17922:x1875475226089216:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788592924.991424:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226088704:12345-0@lo:400:kworker.0 Request processed in 3995us (6024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592924.991442:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:2.0:1788592924.991484:0:17205:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000040:00080000:2.0:1788592924.991515:0:17205:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788592924.991518:0:17205:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788592924.991538:0:17205:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788592924.991601:0:17205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459238533525ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788592924.991607:0:17205:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788592924.993599:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592924.993617:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17206:x1875475226089472:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788592924.993699:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592924.993765:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.993905:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226089344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592924.993929:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.993964:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226087552:0@lo:400:kworker.0 00010000:00080000:0.0:1788592924.993983:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744467800 x1875475226088832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592924.993993:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226088832:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.994003:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226088064:0@lo:400:kworker.0 00010000:00080000:0.0:1788592924.994016:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744466680 x1875475226088704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592924.994024:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226088704:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.994055:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592924.994060:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226089600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788592924.994101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.994126:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089088 00000100:00100000:0.0:1788592924.994132:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089088 00000100:00100000:0.0:1788592924.994154:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089344 00000100:00100000:0.0:1788592924.994156:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089344 00000100:00100000:0.0:1788592924.994165:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592924.994171:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875475226089088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788592924.994191:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788592924.995277:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592924.995303:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788592924.995312:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788592924.995381:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875475226089088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1207us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.995389:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592924.995410:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592924.995417:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875475226089344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592924.995430:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00010000:00080000:1.0:1788592924.995442:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217444c7b80 x1875475226087936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592924.995459:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875475226089344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592924.995465:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226087936:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.995466:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788592924.995478:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744465180 x1875475226088576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592924.995486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226088576:0@lo:400:kworker.0 00010000:00080000:1.0:1788592924.995499:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744467480 x1875475226088448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592924.995506:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226088448:0@lo:400:kworker.0 00010000:00080000:0.0:1788592924.995510:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744466300 x1875475226089088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788592924.995516:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744465f80 x1875475226088960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592924.995523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226088960:0@lo:400:kworker.0 00000100:00100000:0.0:1788592924.995523:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592924.995543:0:18684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788592924.995549:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089600 00000100:00100000:0.0:1788592924.995554:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089600 00010000:00080000:0.0:1788592924.995587:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921741dd8e00 x1875475226089344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592924.995599:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226089344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592924.995634:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592924.995675:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3639:x1875475226089600:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:0.0:1788592924.997864:0:18682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788592924.997871:0:18682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788592924.997956:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17922:x1875475226089216:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6549us (7842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592924.997968:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788592924.998048:0:17922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744464380 x1875475226089216/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592940 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592924.998098:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744464380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17922:1875475226089216:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788592924.998113:0:17922:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788592924.998566:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17922:1875475226089728:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788592924.998609:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.998642:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438550c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788592924.998677:0:17911:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788592924.998940:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089728 00000100:00100000:3.0:1788592924.998947:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089728 00000100:00100000:3.0:1788592924.998993:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788592924.999002:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17922:x1875475226089728:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788592924.999026:0:18684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788592924.999092:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17922:x1875475226089728:12345-0@lo:5:osp-pre-1-1.0 Request processed in 92us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592924.999099:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788592924.999175:0:17922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9217444c7b80 x1875475226089728/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592940 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592924.999185:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17922:1875475226089728:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788592924.999196:0:17922:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788592924.999288:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17922:1875475226089856:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788592924.999314:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592924.999376:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff9217438550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592925.002093:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089856 00000100:00100000:3.0:1788592925.002108:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089856 00000100:00100000:3.0:1788592925.002154:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592925.002163:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17922:x1875475226089856:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788592925.002203:0:18682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:3.0:1788592925.002460:0:17160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:3.0:1788592925.007403:0:19498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788592925.007416:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788592925.007420:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788592925.007621:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226089600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 11962us (13500us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788592925.007632:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788592925.007681:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f487100 x1875475226089600/t0(0) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788592940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788592925.007705:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92186f487100, transno 8589934593 00000100:00100000:3.0:1788592925.007727:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:3.0:1788592925.007733:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92186f487100/2, rc 0, transno 8589934593 00000100:00100000:3.0:1788592925.007739:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226089600:0@lo:2:osp-syn-1-0.0 00000040:00080000:3.0:1788592925.007884:0:17205:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1788592925.007906:0:17205:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00002000:00080000:0.0:1788592925.009620:0:18763:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788592925.009632:0:18763:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788592925.009638:0:18763:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1788592925.020746:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592925.020761:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020779:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788592925.020784:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592925.020790:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020819:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020830:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020837:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020855:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592925.020866:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592925.020871:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020877:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592925.020881:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020889:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020902:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020908:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db624d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.020932:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.020934:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.020936:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.022151:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.022160:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022173:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.022177:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.022182:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022196:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022204:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022212:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022302:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592925.022618:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.022631:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022640:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.022643:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.022647:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022657:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022665:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022672:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.022692:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788592925.022702:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592925.022708:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.022748:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592925.022995:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80a00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592925.023000:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023011:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023025:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023033:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678091b6/0xbd314a3362db6254 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023049:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.023051:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.023052:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.023135:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.023141:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.023149:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.023152:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.023156:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.023166:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.023181:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.023188:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.023204:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592925.023382:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592925.023387:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023403:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592925.023406:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023414:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023424:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023430:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db6262 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.023444:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.023445:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.023447:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.023581:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.023584:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.023585:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.023609:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.023629:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.023632:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.023640:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.023651:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.023658:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93674dc/0xbd314a3362db625b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.023672:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.023674:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.023675:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.024376:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.024383:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.024394:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.024398:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.024403:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.024414:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.024422:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.024430:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.024460:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592925.024553:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.024558:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.024566:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.024569:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.024577:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.024596:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.024603:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59e5516/0xbd314a3362db6269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.024618:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.024619:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.024621:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.025895:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.025903:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.025918:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.025922:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.025928:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.025940:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.025950:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.025958:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.025975:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592925.026298:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.026304:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026312:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.026320:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.026325:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026334:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026342:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026348:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026358:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592925.026442:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592925.026448:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026455:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.026459:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026468:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026483:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026500:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db6270 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026516:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.026519:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026525:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.026528:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026535:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026544:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026550:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6277 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.026560:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.026562:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.026563:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.027950:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592925.028696:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788592925.028706:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.028730:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1788592925.028734:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592925.028740:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.028756:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.028766:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.028774:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.028796:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592925.029426:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.029432:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.029440:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.029444:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.029462:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.029478:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.029484:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f3468cd/0xbd314a3362db627e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.029510:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.029512:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.029514:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592925.030761:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788592925.030781:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.030795:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1788592925.030800:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592925.030806:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.030818:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.030827:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.030835:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.030858:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592925.032695:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.032705:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.032734:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205e400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.032739:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.032750:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.032767:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.032774:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006529a450/0xbd314a3362db6285 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.032796:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.032798:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.032800:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592925.033131:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788592925.033138:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.033150:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1788592925.033154:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592925.033160:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.033172:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.033189:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.033197:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.033219:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592925.033544:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.033550:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.033558:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841495e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.033561:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.033570:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.033588:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.033595:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cba88bf0/0xbd314a3362db628c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.033611:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.033613:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.033615:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592925.034631:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788592925.034639:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.034651:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1788592925.034654:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592925.034660:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.034671:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.034680:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.034687:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592925.034728:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592925.034873:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592925.034880:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.034888:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841494800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592925.034892:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.034901:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.034922:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.034930:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018f5a3e6/0xbd314a3362db6293 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.034950:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.034953:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.034955:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.041322:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.041337:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.041355:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.041360:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.041366:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.041381:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.041392:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.041400:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.041441:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592925.042209:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.042216:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042226:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.042230:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.042234:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042244:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042252:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042259:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042276:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592925.042392:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592925.042399:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042407:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.042418:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042429:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042445:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042453:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db629a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042471:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.042474:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042480:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.042483:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042490:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042500:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042507:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042526:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.042528:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.042529:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.042765:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.042771:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042780:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.042783:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.042787:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042797:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042806:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042813:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.042826:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592925.043453:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.043460:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043479:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.043483:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.043487:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043497:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043506:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043513:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043527:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592925.043615:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592925.043621:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043628:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80c00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.043632:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043640:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043666:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043673:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043688:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.043691:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043697:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.043700:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043708:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043726:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043733:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.043744:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.043746:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.043753:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.046963:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.046975:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.046991:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.046996:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.047002:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047017:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047027:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047035:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047055:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592925.047226:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.047231:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047239:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.047244:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047264:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047283:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047296:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.047316:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.047318:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.047320:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592925.049401:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17922:x1875475226089856:12345-0@lo:5:osp-pre-1-1.0 Request processed in 47229us (50076us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788592925.049416:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788592925.050497:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.050509:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592925.052327:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17922:1875475226089856:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788592925.052349:0:17922:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788592925.052405:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17922:1875475226089984:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788592925.052466:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592925.052494:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592925.052515:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226089984 00000100:00100000:2.0:1788592925.052520:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226089984 00000100:00100000:2.0:1788592925.052568:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592925.052576:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17922:x1875475226089984:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788592925.052627:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17922:x1875475226089984:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592925.052634:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788592925.052683:0:17922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92186f487800 x1875475226089984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788592941 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592925.052694:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17922:1875475226089984:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788592925.053641:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592925.053653:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.053669:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788592925.053673:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592925.053680:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.053696:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.053707:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.053740:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.053761:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788592925.054295:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592925.054302:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054312:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788592925.054315:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592925.054319:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054329:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054338:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054345:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054370:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592925.054667:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592925.054675:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054684:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.054689:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054699:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054728:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054737:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d450d8c/0xbd314a3362db62bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054753:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.054757:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054764:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.054768:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054784:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054797:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054804:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000116590b4/0xbd314a3362db62c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.054818:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.054820:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.054822:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788592925.054908:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788592925.054915:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054930:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788592925.054934:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592925.054938:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054948:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054957:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054964:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592925.054990:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592925.055320:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592925.055326:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.055333:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592925.055337:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.055346:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.055357:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.055378:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9db704/0xbd314a3362db62cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.055395:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.055397:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.055399:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.055689:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.056159:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.056168:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056179:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.056182:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.056188:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056211:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056221:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056229:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056250:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592925.056922:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.056936:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056945:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.056948:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.056953:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056965:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056973:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.056979:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.057052:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788592925.059248:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.059260:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.059276:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.059280:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.059287:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.059304:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.059328:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.059337:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059422:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788592925.059431:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059439:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.059444:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059453:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059470:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059477:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df8905a/0xbd314a3362db62d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059500:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592925.059504:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059518:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.059521:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059528:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059538:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059544:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d0d5cdb/0xbd314a3362db62d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059557:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.059561:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059567:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81c00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.059570:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059576:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059586:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.059601:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.059603:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.059605:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592925.059990:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.061503:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788592925.061517:0:18763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b3a3503/0xbd314a3362db62e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592925.062474:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.062483:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.062497:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.062507:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.062514:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.062527:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.062537:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.062557:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.063120:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.063128:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.063138:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81e00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.063143:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.063153:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.063172:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.063183:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.063185:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.063187:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.063291:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592925.063306:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788592925.063312:0:18763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce06525/0xbd314a3362db62e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592925.063753:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.063759:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.063768:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.063772:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.063777:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.063788:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.063795:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.063803:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.063841:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592925.064128:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.064134:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064141:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.064152:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064161:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064175:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064183:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e0f5d3/0xbd314a3362db62ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064199:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.064200:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.064203:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.064316:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.064322:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064330:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.064334:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.064338:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064348:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064356:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064364:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064386:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592925.064501:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.064506:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064514:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80c00 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.064518:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064526:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064539:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064553:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f633a7a/0xbd314a3362db62f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.064568:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.064571:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.064573:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.064798:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.064804:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064814:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.064823:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.064827:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064838:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064846:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064853:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.064875:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592925.065123:0:19796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.065128:0:19796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.065136:0:19796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.065140:0:19796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.065148:0:19796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.065159:0:19796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.065167:0:19796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1369419/0xbd314a3362db62fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.065181:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.065183:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.065184:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592925.065367:0:18763:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788592925.065373:0:18763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.065381:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788592925.065384:0:18763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592925.065389:0:18763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.065398:0:18763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.065406:0:18763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.065420:0:18763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592925.065841:0:18763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788592925.065888:0:18763:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1788592925.065990:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17206:x1875475226089472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 72377us (74717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592925.066000:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788592925.066087:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17206:1875475226089472:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788592925.066107:0:17206:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788592925.066154:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17206:1875475226090112:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788592925.066190:0:17206:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592925.066225:0:17206:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184960c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592925.066243:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090112 00000100:00100000:2.0:1788592925.066249:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090112 00000100:00100000:2.0:1788592925.066306:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592925.066316:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17206:x1875475226090112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788592925.066355:0:18763:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1788592925.068381:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592925.068392:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.068404:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592925.068410:0:17169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.068422:0:17169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.068442:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.068452:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c05348/0xbd314a3362db6303 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592925.068473:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.068476:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592925.068478:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592925.070037:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17206:x1875475226090112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3717us (3841us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788592925.070052:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592925.070135:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17206:1875475226090112:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788592925.070152:0:17206:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:2.0:1788592925.752913:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788592925.882019:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592925.966013:0:19856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788592926.904240:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788592926.993961:0:19908:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788592926.994556:0:19908:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788592927.038042:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592927.038080:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226090240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592927.038148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592927.038216:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090240 00000100:00100000:2.0:1788592927.038223:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090240 00000100:00100000:2.0:1788592927.038494:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592927.038506:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226090240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592927.038546:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788592927.038599:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226090240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592927.038607:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788592927.038629:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592927.038845:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226090240:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1788592927.899759:0:19958:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788592927.900007:0:19958:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788592927.930261:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592928.056347:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592928.056369:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226090368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592928.056445:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592928.056537:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090368 00000100:00100000:0.0:1788592928.056545:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090368 00000100:00100000:0.0:1788592928.056609:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592928.056618:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226090368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592928.056638:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788592928.056711:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226090368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.056719:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788592928.057260:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592928.057300:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226090368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592928.243195:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.243363:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239168 00000100:00100000:2.0:1788592928.243373:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239168 00000100:00100000:2.0:1788592928.243425:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 114 00000100:00100000:2.0:1788592928.243433:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1875475209239168:12345-192.168.203.47@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788592928.243459:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 56318202-5ccc-4b18-bf05-3f29008f5167@192.168.203.47@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1788592928.243489:0:17172:0:(genops.c:1385:class_connect()) connect: client 56318202-5ccc-4b18-bf05-3f29008f5167, cookie 0xbd314a3362db630a 00000100:00080000:2.0:1788592928.243630:0:17172:0:(import.c:65:import_set_state_nolock()) ffff921744695800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592928.243710:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+5:2392:x1875475209239168:12345-192.168.203.47@tcp:250:mount.lustre.0 Request processed in 275us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.243718:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 114 00000100:00100000:0.0:1788592928.251653:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.254920:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239296 00000100:00100000:1.0:1788592928.254935:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239296 00000100:00100000:1.0:1788592928.255044:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:1.0:1788592928.255055:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+5:14890:x1875475209239296:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788592928.255122:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592928.255144:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022a000/0xbd314a3362db6311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c316b expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.255176:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022a000/0xbd314a3362db6311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c316b expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.255187:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022a000/0xbd314a3362db6311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c316b expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.255197:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022a000, rc 0) 00000100:00100000:1.0:1788592928.255269:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+6:14890:x1875475209239296:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 216us (3624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.255276:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 115 00000100:00100000:3.0:1788592928.269968:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.270204:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239424 00000100:00100000:0.0:1788592928.270214:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239424 00000100:00100000:0.0:1788592928.270274:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:0.0:1788592928.270284:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+6:14890:x1875475209239424:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788592928.270412:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+6:14890:x1875475209239424:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 129us (453us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592928.270419:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 116 00000100:00100000:3.0:1788592928.272526:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.272626:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239552 00000100:00100000:2.0:1788592928.272636:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239552 00000100:00100000:2.0:1788592928.272705:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 117 00000100:00100000:2.0:1788592928.272716:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+6:14890:x1875475209239552:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592928.272730:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592928.272903:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80400/0xbd314a3362db6318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3172 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592928.272935:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80400/0xbd314a3362db6318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3172 expref: 7 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592928.272947:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80400/0xbd314a3362db6318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3172 expref: 7 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592928.272957:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80400, rc 0) 00000100:00100000:2.0:1788592928.273105:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+7:14890:x1875475209239552:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 391us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.273113:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 117 00000100:00100000:2.0:1788592928.275641:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.275746:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239680 00000100:00100000:1.0:1788592928.275755:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239680 00000100:00100000:1.0:1788592928.275823:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 118 00000100:00100000:1.0:1788592928.275834:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+7:14890:x1875475209239680:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592928.276398:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+8:14890:x1875475209239680:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 564us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.276407:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 118 00000100:00100000:2.0:1788592928.284431:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.284531:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239808 00000100:00100000:0.0:1788592928.284540:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239808 00000100:00100000:0.0:1788592928.284596:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 119 00000100:00100000:0.0:1788592928.284605:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+8:14890:x1875475209239808:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788592928.284757:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+8:14890:x1875475209239808:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.284765:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 119 00000100:00100000:3.0:1788592928.290247:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.291217:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209239936 00000100:00100000:1.0:1788592928.291229:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209239936 00000100:00100000:0.0:1788592928.291559:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 120 00000100:00100000:0.0:1788592928.291574:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+8:14910:x1875475209239936:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592928.291760:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+8:14910:x1875475209239936:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 190us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.292473:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 120 00000100:00100000:2.0:1788592928.321636:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.321848:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240064 00000100:00100000:1.0:1788592928.321859:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240064 00000100:00100000:1.0:1788592928.321972:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:1.0:1788592928.322003:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+8:14910:x1875475209240064:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592928.322207:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+8:14910:x1875475209240064:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 206us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.322215:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 121 00000100:00100000:3.0:1788592928.330796:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.330963:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240192 00000100:00100000:2.0:1788592928.330973:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240192 00000100:00100000:2.0:1788592928.331036:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:2.0:1788592928.331046:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+8:14910:x1875475209240192:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592928.331249:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+8:14910:x1875475209240192:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 204us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.331258:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 122 00000100:00100000:1.0:1788592928.338491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.338590:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240320 00000100:00100000:0.0:1788592928.338601:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240320 00000100:00100000:0.0:1788592928.338677:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00100000:0.0:1788592928.338688:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92185b018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+8:14890:x1875475209240320:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788592928.338716:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592928.338735:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f1e00/0xbd314a3362db631f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c31a3 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592928.338764:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f1e00/0xbd314a3362db631f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31a3 expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592928.338919:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f1e00/0xbd314a3362db631f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31a3 expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592928.338929:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1e00, rc 0) 00000100:00100000:0.0:1788592928.338984:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92185b018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+9:14890:x1875475209240320:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 298us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.338991:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 123 00000100:00100000:3.0:1788592928.345195:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.346279:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240448 00000100:00100000:0.0:1788592928.346290:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240448 00000100:00100000:0.0:1788592928.346563:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00100000:0.0:1788592928.346574:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92185b018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+9:14890:x1875475209240448:12345-192.168.203.47@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788592928.346600:0:17172:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788592928.346629:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788592928.346633:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788592928.346637:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788592928.346639:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788592928.346642:0:17172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788592928.355254:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92185b018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+9:14890:x1875475209240448:12345-192.168.203.47@tcp:256:mount.lustre.0 Request processed in 8672us (10057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.355718:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 124 00000100:00100000:1.0:1788592928.360838:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.362507:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240576 00000100:00100000:0.0:1788592928.362525:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240576 00000100:00100000:0.0:1788592928.362616:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 125 00000100:00100000:0.0:1788592928.362625:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92185b018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+9:14890:x1875475209240576:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788592928.362640:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592928.362660:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c31aa expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592928.362689:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592928.362712:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592928.362721:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1800, rc 0) 00000100:00100000:0.0:1788592928.362795:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92185b018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+10:14890:x1875475209240576:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 171us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.362802:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 125 00000100:00100000:3.0:1788592928.368392:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.371132:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240704 00000100:00100000:0.0:1788592928.371146:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240704 00000100:00100000:0.0:1788592928.371216:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 126 00000100:00100000:0.0:1788592928.371227:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921852dd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+10:14890:x1875475209240704:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788592928.372221:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921852dd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+10:14890:x1875475209240704:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 992us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.372231:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 126 00000100:00100000:3.0:1788592928.374540:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.374676:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240832 00000100:00100000:2.0:1788592928.374687:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240832 00000100:00100000:2.0:1788592928.374761:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 127 00000100:00100000:2.0:1788592928.374771:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921852dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+10:14890:x1875475209240832:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788592928.375241:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921852dd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+10:14890:x1875475209240832:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 461us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.375250:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 127 00000100:00100000:1.0:1788592928.383194:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592928.383433:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209240960 00000100:00100000:0.0:1788592928.383443:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209240960 00000100:00100000:0.0:1788592928.383499:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:0.0:1788592928.383510:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+10:14913:x1875475209240960:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592928.383679:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+10:14913:x1875475209240960:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 171us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.383688:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 128 00000100:00100000:2.0:1788592928.391879:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.392038:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241088 00000100:00100000:1.0:1788592928.392047:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241088 00000100:00100000:1.0:1788592928.392132:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 129 00000100:00100000:1.0:1788592928.392144:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+10:14913:x1875475209241088:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592928.392316:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+10:14913:x1875475209241088:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 174us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.392325:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 129 00000100:00100000:2.0:1788592928.405908:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.406155:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241216 00000100:00100000:1.0:1788592928.406166:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241216 00000100:00100000:1.0:1788592928.406222:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:1.0:1788592928.406231:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875475209241216:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788592928.406262:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a1b09db4-0481-49f3-89da-591dd9a69226@192.168.203.47@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1788592928.406316:0:18707:0:(genops.c:1385:class_connect()) connect: client a1b09db4-0481-49f3-89da-591dd9a69226, cookie 0xbd314a3362db632d 00000004:00100000:1.0:1788592928.406346:0:18707:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788592928.406599:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9217444db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592928.406675:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+6:2392:x1875475209241216:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 443us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.406683:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:3.0:1788592928.411575:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592928.411620:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.411731:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241344 00000100:00100000:2.0:1788592928.411742:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241344 00000100:00100000:2.0:1788592928.411924:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241472 00000100:00100000:2.0:1788592928.411929:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241472 00000100:00100000:2.0:1788592928.411955:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:2.0:1788592928.411966:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+6:0:x1875475209241344:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788592928.412000:0:17181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788592928.412113:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+6:0:x1875475209241344:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 149us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.412122:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:2.0:1788592928.412144:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:2.0:1788592928.412150:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875475209241472:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788592928.412176:0:17181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a1b09db4-0481-49f3-89da-591dd9a69226@192.168.203.47@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1788592928.412228:0:17181:0:(genops.c:1385:class_connect()) connect: client a1b09db4-0481-49f3-89da-591dd9a69226, cookie 0xbd314a3362db6334 00000004:00100000:2.0:1788592928.412250:0:17181:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788592928.412511:0:17181:0:(import.c:65:import_set_state_nolock()) ffff92174383e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592928.412540:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+6:2392:x1875475209241472:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 389us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.412546:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00080000:3.0:1788592928.413293:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592928.415877:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.416053:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241728 00000100:00100000:1.0:1788592928.416063:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241728 00000100:00100000:1.0:1788592928.416604:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:1.0:1788592928.416622:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209241728:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788592928.416653:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788592928.416738:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209241728:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 122us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.416746:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:2.0:1788592928.417576:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.417655:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241600 00000100:00100000:1.0:1788592928.417662:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241600 00000100:00100000:1.0:1788592928.417730:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:1.0:1788592928.417739:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+6:0:x1875475209241600:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788592928.417765:0:18707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:2.0:1788592928.417857:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788592928.417948:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+6:0:x1875475209241600:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 210us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.417956:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:3.0:1788592928.430645:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.430843:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241856 00000100:00100000:1.0:1788592928.430853:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241856 00000100:00100000:1.0:1788592928.430918:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:1.0:1788592928.430928:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209241856:12345-192.168.203.47@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788592928.431050:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209241856:12345-192.168.203.47@tcp:40:mount.lustre.0 Request processed in 122us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.431059:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:2.0:1788592928.438442:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.438496:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592928.438607:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209241984 00000100:00100000:3.0:1788592928.438627:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209241984 00000100:00100000:3.0:1788592928.438667:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242112 00000100:00100000:3.0:1788592928.438671:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242112 00000100:00100000:3.0:1788592928.438688:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:3.0:1788592928.438705:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875475209241984:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788592928.438738:0:18682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a1b09db4-0481-49f3-89da-591dd9a69226@192.168.203.47@tcp t0 exp 0000000000000000 cur 462 last 0 00000100:00100000:0.0:1788592928.438743:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:0.0:1788592928.438749:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875475209242112:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788592928.438764:0:18684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a1b09db4-0481-49f3-89da-591dd9a69226@192.168.203.47@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1788592928.438784:0:18682:0:(genops.c:1385:class_connect()) connect: client a1b09db4-0481-49f3-89da-591dd9a69226, cookie 0xbd314a3362db633b 00000020:00000080:0.0:1788592928.438791:0:18684:0:(genops.c:1385:class_connect()) connect: client a1b09db4-0481-49f3-89da-591dd9a69226, cookie 0xbd314a3362db6342 00002000:00100000:3.0:1788592928.438796:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1b09db4-0481-49f3-89da-591dd9a69226/ffff921842b92000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788592928.438796:0:18684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1b09db4-0481-49f3-89da-591dd9a69226/ffff92187c4e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592928.438805:0:18682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1788592928.438810:0:18684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788592928.438956:0:18684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1788592928.438958:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788592928.439265:0:18684:0:(import.c:65:import_set_state_nolock()) ffff92187c4e5000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788592928.439385:0:18682:0:(import.c:65:import_set_state_nolock()) ffff921842b95800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592928.439437:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:2392:x1875475209241984:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 731us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592928.439445:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:2.0:1788592928.439704:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592928.447488:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242240 00000100:00100000:3.0:1788592928.447505:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242240 00000100:00100000:3.0:1788592928.447585:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:3.0:1788592928.447596:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209242240:12345-192.168.203.47@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788592928.448422:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209242240:12345-192.168.203.47@tcp:900:mount.lustre.0 Request processed in 825us (8724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592928.448433:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:0.0:1788592928.449602:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1b09db4-0481-49f3-89da-591dd9a69226+6:2392:x1875475209242112:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 10843us (11097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592928.449614:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:1.0:1788592928.456964:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592928.460790:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242368 00000100:00100000:2.0:1788592928.460805:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242368 00000100:00100000:2.0:1788592928.460956:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:2.0:1788592928.460968:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209242368:12345-192.168.203.47@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788592928.463891:0:17182:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2835us 00000004:00200000:2.0:1788592928.494041:0:17182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788592928.494258:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14890:x1875475209242368:12345-192.168.203.47@tcp:33:mount.lustre.0 Request processed in 33286us (37298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592928.494269:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:0.0:1788592928.730768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592928.731038:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242496 00000100:00100000:1.0:1788592928.731048:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242496 00000100:00100000:1.0:1788592928.731173:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:1.0:1788592928.731184:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+6:14936:x1875475209242496:12345-192.168.203.47@tcp:101:mkdir.0 00010000:00010000:1.0:1788592928.731202:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592928.731229:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db6349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c31db expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.731410:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db6350 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.731424:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db6350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.731438:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db6350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592928.731486:0:18707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788592928.731490:0:18707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788592928.731524:0:18707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db6350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.731550:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022be00/0xbd314a3362db6349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31db expref: 8 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.731569:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db6350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31db expref: 7 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592928.731577:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:1.0:1788592928.731580:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592928.731583:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b000, rc 0) 00000100:00100000:1.0:1788592928.731648:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+7:14936:x1875475209242496:12345-192.168.203.47@tcp:101:mkdir.0 Request processed in 465us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592928.731661:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00010000:00010000:1.0:1788592928.952864:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592929.080335:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226090496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788592929.080418:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592929.080493:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592929.080500:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226090624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592929.080525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592929.080588:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090496 00000100:00100000:0.0:1788592929.080596:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090496 00000100:00100000:0.0:1788592929.080634:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090624 00000100:00100000:0.0:1788592929.080637:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090624 00000100:00100000:0.0:1788592929.080651:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788592929.080659:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226090496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788592929.080701:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788592929.080746:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226090496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592929.080752:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788592929.080767:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592929.080773:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226090624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592929.080807:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788592929.080838:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226090624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592929.080845:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592929.080893:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226090624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788592929.080919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226090496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788592929.976263:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592930.104816:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226091008:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.104885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.104943:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226091520:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.104966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.104984:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226092032:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.105031:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788592930.105036:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226091136:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105057:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.105115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226091648:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.105151:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226092160:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.105322:0:19795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091008 00000100:00100000:1.0:1788592930.105396:0:19795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091008 00000100:00100000:1.0:1788592930.105451:0:19795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091520 00000100:00100000:1.0:1788592930.105455:0:19795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091520 00000100:00100000:1.0:1788592930.105469:0:19795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091136 00000100:00100000:1.0:1788592930.105472:0:19795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091136 00000100:00100000:1.0:1788592930.105482:0:19795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091648 00000100:00100000:1.0:1788592930.105484:0:19795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091648 00000100:00100000:1.0:1788592930.105500:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592930.105508:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226091008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105811:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226091008:12345-0@lo:400:kworker.0 Request processed in 302us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.105818:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592930.105837:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592930.105844:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226091520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105872:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226091520:12345-0@lo:400:kworker.0 Request processed in 30us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.105877:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592930.105886:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592930.105892:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226091136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105914:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1875475226091136:12345-0@lo:400:kworker.0 Request processed in 23us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.105919:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592930.105930:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592930.105935:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3639:x1875475226091648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.105960:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3639:x1875475226091648:12345-0@lo:400:kworker.0 Request processed in 25us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.105966:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592930.105985:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092032 00000100:00100000:1.0:1788592930.105989:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092032 00000100:00100000:1.0:1788592930.106017:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092160 00000100:00100000:1.0:1788592930.106021:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092160 00000100:00100000:1.0:1788592930.106040:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592930.106046:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226092032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.106117:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875475226092032:12345-0@lo:400:kworker.0 Request processed in 72us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.106133:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592930.106145:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592930.106150:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226092160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.106340:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226090880:0@lo:400:kworker.0 00000100:00100000:3.0:1788592930.106467:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226090752:0@lo:400:kworker.0 00000100:00100000:0.0:1788592930.106832:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226092544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592930.108841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592930.108903:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226091392:0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.108940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592930.108959:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226091904:0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.109016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592930.109031:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226092416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592930.109054:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592930.109134:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091904 00000100:00100000:2.0:1788592930.109142:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091904 00000100:00100000:2.0:1788592930.109522:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788592930.109533:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226091904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.109651:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875475226091904:12345-0@lo:400:kworker.0 Request processed in 121us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592930.109659:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788592930.109691:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592930.109696:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592930.109699:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592930.109702:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592930.109746:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1875475226091904:0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.109809:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092416 00000100:00100000:2.0:1788592930.109813:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092416 00000100:00100000:2.0:1788592930.109841:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592930.109848:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226092416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592930.109871:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788592930.109903:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226092416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592930.109909:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592930.109930:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090880 00000100:00100000:2.0:1788592930.109934:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090880 00000100:00100000:2.0:1788592930.109950:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091392 00000100:00100000:2.0:1788592930.109953:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091392 00000100:00100000:2.0:1788592930.109964:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788592930.109970:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226090880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.110000:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226090880:12345-0@lo:400:kworker.0 Request processed in 31us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592930.110006:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788592930.110015:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788592930.110020:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226091392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.110050:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226091392:12345-0@lo:400:kworker.0 Request processed in 30us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592930.110055:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788592930.110296:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226090880:0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.110308:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226091392:0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.110392:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226092416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592930.117188:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226092160:12345-0@lo:400:kworker.0 Request processed in 11027us (12004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.117205:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592930.118562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592930.118808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226091264:0@lo:400:kworker.0 00000100:00100000:3.0:1788592930.118859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592930.118959:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226091776:0@lo:400:kworker.0 00000100:00100000:3.0:1788592930.118983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592930.119038:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226090752 00000100:00100000:1.0:1788592930.119047:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226090752 00000100:00100000:1.0:1788592930.119129:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788592930.119138:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226090752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.119188:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226090752:12345-0@lo:400:kworker.0 Request processed in 51us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.119195:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788592930.119833:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592930.119952:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226091136:0@lo:400:kworker.0 00000100:00100000:0.0:1788592930.119967:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226091648:0@lo:400:kworker.0 00000100:00100000:0.0:1788592930.119981:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226092160:0@lo:400:kworker.0 00000100:00100000:0.0:1788592930.120011:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226091008:0@lo:400:kworker.0 00000100:00100000:0.0:1788592930.120054:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226091520:0@lo:400:kworker.0 00010000:00080000:0.0:1788592930.120082:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b41880 x1875475226092032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592930.120093:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1875475226092032:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.122275:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092544 00000100:00100000:1.0:1788592930.122289:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092544 00000100:00100000:1.0:1788592930.122379:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788592930.122389:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875475226092544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788592930.122417:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788592930.122606:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875475226092544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 218us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.122614:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592930.122719:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921741dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226092544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592930.124547:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226092288:0@lo:400:kworker.0 00000100:00100000:3.0:1788592930.124634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592930.125486:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091264 00000100:00100000:2.0:1788592930.125498:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091264 00000100:00100000:2.0:1788592930.125562:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226091776 00000100:00100000:2.0:1788592930.126261:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226091776 00000100:00100000:1.0:1788592930.126269:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788592930.126284:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226091264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592930.126304:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788592930.126315:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226091776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.126364:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226091264:12345-0@lo:400:kworker.0 Request processed in 86us (7504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.126391:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788592930.126437:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875475226091776:12345-0@lo:400:kworker.0 Request processed in 124us (7451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592930.126444:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592930.128156:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226090752:0@lo:400:kworker.0 00000100:00100000:3.0:1788592930.128201:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226091264:0@lo:400:kworker.0 00000100:00100000:3.0:1788592930.128213:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875475226091776:0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.128354:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092288 00000100:00100000:1.0:1788592930.128361:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092288 00000100:00100000:1.0:1788592930.128428:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788592930.128436:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226092288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592930.128493:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875475226092288:12345-0@lo:400:kworker.0 Request processed in 58us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.128499:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788592930.128745:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788592930.128809:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921743b43b80 x1875475226092288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592930.128820:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1875475226092288:0@lo:400:kworker.0 00000001:00100000:2.0:1788592930.619528:0:17160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1b09db4-0481-49f3-89da-591dd9a69226 00000001:00100000:2.0:1788592930.620855:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1b09db4-0481-49f3-89da-591dd9a69226 00000001:00080000:2.0:1788592930.620867:0:19498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1788592930.620884:0:19498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1788592930.800659:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592930.802290:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242624 00000100:00100000:0.0:1788592930.802302:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242624 00000100:00100000:0.0:1788592930.802447:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:0.0:1788592930.802457:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+6:14988:x1875475209242624:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:0.0:1788592930.802491:0:17181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788592930.802581:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+6:14988:x1875475209242624:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 125us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592930.802588:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00080000:2.0:1788592930.802701:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592930.807331:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592930.808588:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242752 00000100:00100000:3.0:1788592930.808649:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242752 00000100:00080000:2.0:1788592930.808716:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592930.810002:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:3.0:1788592930.810022:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14988:x1875475209242752:12345-192.168.203.47@tcp:41:lfs.0 00000004:00000024:3.0:1788592930.810064:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788592930.810196:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+6:14988:x1875475209242752:12345-192.168.203.47@tcp:41:lfs.0 Request processed in 183us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592930.810204:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:0.0:1788592930.817108:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592930.817316:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209242880 00000100:00100000:2.0:1788592930.817327:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209242880 00000100:00100000:2.0:1788592930.817522:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00100000:2.0:1788592930.817533:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1b09db4-0481-49f3-89da-591dd9a69226+6:14988:x1875475209242880:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:2.0:1788592930.817566:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788592930.817861:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1b09db4-0481-49f3-89da-591dd9a69226+6:14988:x1875475209242880:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 329us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592930.817870:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 12 00000100:00080000:0.0:1788592930.818824:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592930.824171:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592930.824365:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243008 00000100:00100000:1.0:1788592930.824388:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243008 00000100:00100000:1.0:1788592930.824465:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:1.0:1788592930.824476:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1b09db4-0481-49f3-89da-591dd9a69226+5:14988:x1875475209243008:12345-192.168.203.47@tcp:13:lfs.0 00002000:00000024:1.0:1788592930.824498:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788592930.824579:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1b09db4-0481-49f3-89da-591dd9a69226+5:14988:x1875475209243008:12345-192.168.203.47@tcp:13:lfs.0 Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592930.824587:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00080000:0.0:1788592930.825716:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788592931.000401:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592931.054470:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.054607:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243136 00000100:00100000:2.0:1788592931.054618:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243136 00000100:00100000:2.0:1788592931.054695:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:2.0:1788592931.054708:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+10:15019:x1875475209243136:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592931.054728:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592931.054751:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81400/0xbd314a3362db6357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c31e2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592931.054785:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81400/0xbd314a3362db6357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31e2 expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592931.054797:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81400/0xbd314a3362db6357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31e2 expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592931.054806:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81400, rc 0) 00000100:00100000:2.0:1788592931.054887:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+11:15019:x1875475209243136:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 182us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.054895:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 131 00000100:00100000:3.0:1788592931.061342:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592931.063635:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243264 00000100:00100000:1.0:1788592931.063650:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243264 00000100:00100000:1.0:1788592931.063754:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:1.0:1788592931.063766:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+11:15019:x1875475209243264:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592931.063964:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+11:15019:x1875475209243264:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 198us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.063973:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 132 00000100:00100000:3.0:1788592931.072433:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592931.072613:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243392 00000100:00100000:1.0:1788592931.072647:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243392 00000100:00100000:1.0:1788592931.072717:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 133 00000100:00100000:1.0:1788592931.072727:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+11:15019:x1875475209243392:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788592931.072863:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+11:15019:x1875475209243392:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 137us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.072871:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 133 00000100:00100000:3.0:1788592931.078227:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.078350:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243520 00000100:00100000:2.0:1788592931.078377:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243520 00000100:00100000:2.0:1788592931.078438:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 134 00000100:00100000:2.0:1788592931.078448:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921742a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+11:15027:x1875475209243520:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592931.078593:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921742a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+11:15027:x1875475209243520:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.078612:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 134 00000100:00100000:3.0:1788592931.118639:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592931.118766:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243648 00000100:00100000:0.0:1788592931.118776:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243648 00000100:00100000:0.0:1788592931.118835:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 135 00000100:00100000:0.0:1788592931.118847:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+11:15027:x1875475209243648:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592931.119015:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+11:15027:x1875475209243648:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 169us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592931.119022:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 135 00000100:00100000:3.0:1788592931.122415:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592931.122611:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243776 00000100:00100000:1.0:1788592931.122621:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243776 00000100:00100000:1.0:1788592931.122693:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 136 00000100:00100000:1.0:1788592931.122703:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+11:15027:x1875475209243776:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592931.122860:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+11:15027:x1875475209243776:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 157us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.122868:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 136 00000100:00100000:3.0:1788592931.128759:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.129484:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209243904 00000100:00100000:2.0:1788592931.129495:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209243904 00000100:00100000:2.0:1788592931.129570:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 137 00000100:00100000:2.0:1788592931.129580:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+11:15019:x1875475209243904:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592931.129596:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592931.129614:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b81600/0xbd314a3362db635e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3213 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592931.129643:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b81600/0xbd314a3362db635e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3213 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592931.129654:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b81600/0xbd314a3362db635e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3213 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592931.129668:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81600, rc 0) 00000100:00100000:2.0:1788592931.129737:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+12:15019:x1875475209243904:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 158us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.129743:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 137 00000100:00100000:3.0:1788592931.143962:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592931.144858:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244032 00000100:00100000:0.0:1788592931.144889:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244032 00000100:00100000:0.0:1788592931.144960:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 138 00000100:00100000:0.0:1788592931.144971:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+12:15019:x1875475209244032:12345-192.168.203.47@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788592931.144997:0:17172:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788592931.145015:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788592931.145019:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788592931.145023:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788592931.145026:0:17172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788592931.145028:0:17172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788592931.148846:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+12:15019:x1875475209244032:12345-192.168.203.47@tcp:256:mount.lustre.0 Request processed in 3865us (4882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592931.148861:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 138 00000100:00100000:3.0:1788592931.161328:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592931.161558:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244160 00000100:00100000:1.0:1788592931.161567:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244160 00000100:00100000:1.0:1788592931.161627:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 139 00000100:00100000:1.0:1788592931.161638:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+12:15019:x1875475209244160:12345-192.168.203.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788592931.161654:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592931.161682:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c321a expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592931.161713:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592931.161725:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592931.161756:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b200, rc 0) 00000100:00100000:1.0:1788592931.161816:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+13:15019:x1875475209244160:12345-192.168.203.47@tcp:101:mount.lustre.0 Request processed in 180us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.161823:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 139 00000100:00100000:3.0:1788592931.170694:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592931.170807:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244288 00000100:00100000:0.0:1788592931.170818:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244288 00000100:00100000:0.0:1788592931.170883:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:0.0:1788592931.170893:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:15019:x1875475209244288:12345-192.168.203.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788592931.171056:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:15019:x1875475209244288:12345-192.168.203.47@tcp:501:mount.lustre.0 Request processed in 165us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592931.171063:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 140 00000100:00100000:3.0:1788592931.176725:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.176846:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244416 00000100:00100000:2.0:1788592931.176856:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244416 00000100:00100000:2.0:1788592931.176921:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 141 00000100:00100000:2.0:1788592931.176933:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:15019:x1875475209244416:12345-192.168.203.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788592931.177175:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:15019:x1875475209244416:12345-192.168.203.47@tcp:503:mount.lustre.0 Request processed in 243us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.177183:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 141 00000100:00100000:3.0:1788592931.180883:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592931.180981:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244544 00000100:00100000:1.0:1788592931.180991:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244544 00000100:00100000:1.0:1788592931.181051:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:1.0:1788592931.181061:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+13:15030:x1875475209244544:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592931.181238:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+13:15030:x1875475209244544:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 177us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.181246:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 142 00000100:00100000:3.0:1788592931.186587:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592931.196146:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244672 00000100:00100000:0.0:1788592931.196162:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244672 00000100:00100000:0.0:1788592931.196345:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 143 00000100:00100000:0.0:1788592931.196357:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:15030:x1875475209244672:12345-192.168.203.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592931.196523:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:15030:x1875475209244672:12345-192.168.203.47@tcp:502:llog_process_th.0 Request processed in 167us (9944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592931.196530:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 143 00000100:00100000:3.0:1788592931.204647:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592931.204698:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592931.204988:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244800 00000100:00100000:1.0:1788592931.204998:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244800 00000100:00100000:1.0:1788592931.205056:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245056 00000100:00100000:1.0:1788592931.205059:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245056 00000100:00100000:1.0:1788592931.205114:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:1.0:1788592931.205121:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875475209244800:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788592931.205159:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83@192.168.203.47@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:1.0:1788592931.205201:0:18707:0:(genops.c:1385:class_connect()) connect: client 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83, cookie 0xbd314a3362db636c 00000004:00100000:1.0:1788592931.205224:0:18707:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788592931.205425:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9217447ff000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592931.205491:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2392:x1875475209244800:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 368us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.205498:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:1.0:1788592931.205537:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:1.0:1788592931.205541:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875475209245056:12345-192.168.203.47@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788592931.205572:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83@192.168.203.47@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:1.0:1788592931.205594:0:18707:0:(genops.c:1385:class_connect()) connect: client 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83, cookie 0xbd314a3362db6373 00000004:00100000:1.0:1788592931.205607:0:18707:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788592931.205661:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9217447fd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592931.205698:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2392:x1875475209245056:12345-192.168.203.47@tcp:38:mount.lustre.0 Request processed in 154us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592931.205705:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:3.0:1788592931.212201:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592931.212242:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592931.212283:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.212435:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245312 00000100:00100000:2.0:1788592931.212445:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245312 00000100:00100000:2.0:1788592931.212520:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245184 00000100:00100000:2.0:1788592931.212523:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245184 00000100:00100000:2.0:1788592931.212536:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209244928 00000100:00100000:2.0:1788592931.212538:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209244928 00000100:00100000:2.0:1788592931.212553:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:2.0:1788592931.212562:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:15019:x1875475209245312:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788592931.212594:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788592931.212659:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:15019:x1875475209245312:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.212667:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:2.0:1788592931.212695:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:2.0:1788592931.212702:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:0:x1875475209245184:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788592931.212715:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788592931.212746:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:0:x1875475209245184:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 44us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.212752:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:2.0:1788592931.212763:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:2.0:1788592931.212770:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:0:x1875475209244928:12345-192.168.203.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788592931.212780:0:17180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788592931.212801:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:0:x1875475209244928:12345-192.168.203.47@tcp:41:mount.lustre.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.212828:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00080000:3.0:1788592931.213665:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592931.213671:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592931.216739:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.216845:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245440 00000100:00100000:2.0:1788592931.216854:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245440 00000100:00100000:2.0:1788592931.216918:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:2.0:1788592931.216929:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15019:x1875475209245440:12345-192.168.203.47@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788592931.217016:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15019:x1875475209245440:12345-192.168.203.47@tcp:40:mount.lustre.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592931.217024:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:2.0:1788592931.220359:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.220401:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592931.220433:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592931.220531:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245824 00000100:00100000:0.0:1788592931.220541:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245824 00000100:00100000:0.0:1788592931.220598:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:0.0:1788592931.220608:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15019:x1875475209245824:12345-192.168.203.47@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788592931.220686:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15019:x1875475209245824:12345-192.168.203.47@tcp:900:mount.lustre.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592931.220694:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1788592931.220854:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245568 00000100:00100000:3.0:1788592931.220859:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245568 00000100:00100000:3.0:1788592931.220886:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245696 00000100:00100000:3.0:1788592931.220889:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245696 00000100:00100000:3.0:1788592931.220902:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:3.0:1788592931.220907:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875475209245568:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788592931.220933:0:18763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83@192.168.203.47@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788592931.220966:0:18763:0:(genops.c:1385:class_connect()) connect: client 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83, cookie 0xbd314a3362db637a 00002000:00100000:3.0:1788592931.220981:0:18763:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83/ffff921744608800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592931.220992:0:18763:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788592931.221102:0:18763:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788592931.221128:0:18763:0:(import.c:65:import_set_state_nolock()) ffff92174460d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592931.221164:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2392:x1875475209245568:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 255us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592931.221171:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:3.0:1788592931.221186:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:3.0:1788592931.221195:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875475209245696:12345-192.168.203.47@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788592931.221211:0:18763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83@192.168.203.47@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788592931.221229:0:18763:0:(genops.c:1385:class_connect()) connect: client 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83, cookie 0xbd314a3362db6381 00002000:00100000:3.0:1788592931.221252:0:18763:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83/ffff92174460a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592931.221258:0:18763:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788592931.221302:0:18763:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788592931.221317:0:18763:0:(import.c:65:import_set_state_nolock()) ffff92174460f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592931.221340:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2392:x1875475209245696:12345-192.168.203.47@tcp:8:mount.lustre.0 Request processed in 143us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592931.221346:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:2.0:1788592931.228413:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592931.228509:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209245952 00000100:00100000:3.0:1788592931.228519:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209245952 00000100:00100000:3.0:1788592931.228603:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:3.0:1788592931.228613:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15019:x1875475209245952:12345-192.168.203.47@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788592931.228877:0:17183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788592931.228975:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15019:x1875475209245952:12345-192.168.203.47@tcp:33:mount.lustre.0 Request processed in 363us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592931.228983:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:3.0:1788592931.426953:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592931.427762:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246080 00000100:00100000:0.0:1788592931.427778:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246080 00000100:00100000:0.0:1788592931.427935:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:0.0:1788592931.427950:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15053:x1875475209246080:12345-192.168.203.47@tcp:101:mkdir.0 00010000:00010000:0.0:1788592931.427980:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592931.428010:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db6388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c324b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592931.428253:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592931.428275:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592931.428291:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592931.428354:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592931.428359:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592931.428386:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592931.428419:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db6388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592931.428461:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592931.428471:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:0.0:1788592931.428474:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592931.428478:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0600, rc 0) 00000100:00100000:0.0:1788592931.428577:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:15053:x1875475209246080:12345-192.168.203.47@tcp:101:mkdir.0 Request processed in 631us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592931.428586:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00010000:00010000:0.0:1788592932.028838:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592932.159635:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592932.159678:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226092672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592932.159799:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592932.159913:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092672 00000100:00100000:1.0:1788592932.159925:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092672 00000100:00100000:1.0:1788592932.160003:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592932.160016:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226092672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592932.160046:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788592932.160144:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226092672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592932.160151:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592932.160419:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226092672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788592932.160507:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788592933.054544:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592933.177353:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592933.177386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226092800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592933.177451:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592933.177699:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092800 00000100:00100000:1.0:1788592933.177707:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092800 00000100:00100000:1.0:1788592933.177775:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592933.177786:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226092800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788592933.177817:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788592933.177871:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226092800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592933.177887:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788592933.177946:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592933.177991:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226092800:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788592933.433727:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788592933.696997:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83 00000001:00100000:2.0:1788592933.697011:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1b09db4-0481-49f3-89da-591dd9a69226 00000001:00100000:2.0:1788592933.697402:0:17911:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83 00000001:00100000:2.0:1788592933.697411:0:17911:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a1b09db4-0481-49f3-89da-591dd9a69226 00010000:00010000:2.0:1788592934.081338:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592934.200844:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226092928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788592934.200945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592934.201041:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226092928 00000100:00100000:3.0:1788592934.201050:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226092928 00000100:00100000:3.0:1788592934.201138:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592934.201156:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226092928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788592934.201198:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788592934.201275:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226092928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592934.201283:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592934.201337:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226092928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592934.201641:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592934.201661:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226093056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788592934.201704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592934.201895:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093056 00000100:00100000:3.0:1788592934.201900:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093056 00000100:00100000:3.0:1788592934.201930:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592934.201937:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226093056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788592934.201958:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788592934.201996:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226093056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592934.202003:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592934.202034:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226093056:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788592934.577815:0:20056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788592935.096346:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592935.224581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226093184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592935.224695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.225373:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093184 00000100:00100000:0.0:1788592935.225385:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093184 00000100:00100000:0.0:1788592935.225458:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788592935.225470:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226093184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592935.225508:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788592935.225573:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226093184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592935.225580:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788592935.225604:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592935.225740:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226093568:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.225781:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592935.225822:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093568 00000100:00100000:2.0:1788592935.225826:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093568 00000100:00100000:2.0:1788592935.225864:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592935.225872:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226093568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.225911:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226093568:12345-0@lo:400:kworker.0 Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592935.225918:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592935.225958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226093568:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.225997:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592935.226003:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226093696:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226031:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592935.226059:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093696 00000100:00100000:2.0:1788592935.226063:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093696 00000100:00100000:2.0:1788592935.226121:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592935.226129:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226093696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226165:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226093696:12345-0@lo:400:kworker.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592935.226171:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592935.226193:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226093696:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226364:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226094080:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226390:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592935.226430:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592935.226436:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226094208:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226457:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592935.226521:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226094592:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226546:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592935.226584:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592935.226590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226094720:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.226634:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592935.226791:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094208 00000100:00100000:1.0:1788592935.226796:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094208 00000100:00100000:1.0:1788592935.226821:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094592 00000100:00100000:1.0:1788592935.226824:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094592 00000100:00100000:1.0:1788592935.226838:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094720 00000100:00100000:1.0:1788592935.226841:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094720 00000100:00100000:1.0:1788592935.226856:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788592935.226864:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592935.226905:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875475226094208:12345-0@lo:400:kworker.0 Request processed in 43us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592935.226912:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788592935.226926:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788592935.226932:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592935.226958:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226094592:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592935.226964:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788592935.226975:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788592935.226982:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226094720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592935.227008:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875475226094720:12345-0@lo:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592935.227013:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788592935.227402:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92187c487100 x1875475226094720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592935.227417:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1875475226094720:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.227430:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226094592:0@lo:400:kworker.0 00000100:00100000:2.0:1788592935.227441:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875475226094208:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227551:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226093312:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227598:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.227627:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226093824:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.227693:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226094336:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.227742:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592935.227748:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226093440:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.227784:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226093952:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227806:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.227825:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187c486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226094464:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592935.227870:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094080 00000100:00100000:0.0:1788592935.227876:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094080 00000100:00100000:0.0:1788592935.227911:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093952 00000100:00100000:0.0:1788592935.227914:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093952 00000100:00100000:0.0:1788592935.227939:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592935.227947:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187c485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.227985:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187c485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226094080:12345-0@lo:400:kworker.0 Request processed in 39us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592935.227991:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592935.228004:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592935.228010:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226093952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.228038:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226093952:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592935.228044:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592935.228062:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094336 00000100:00100000:0.0:1788592935.228091:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094336 00000100:00100000:0.0:1788592935.228123:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094464 00000100:00100000:0.0:1788592935.228126:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094464 00000100:00100000:0.0:1788592935.228151:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592935.228166:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226094336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.228200:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226094336:12345-0@lo:400:kworker.0 Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592935.228206:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592935.228354:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788592935.228362:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226094464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.228392:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226094464:12345-0@lo:400:kworker.0 Request processed in 32us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592935.228398:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788592935.228421:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592935.228427:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592935.228429:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592935.228431:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592935.228462:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226093952:0@lo:400:kworker.0 00010000:00080000:0.0:1788592935.228475:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92187c486d80 x1875475226094464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592935.228486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226094464:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.228497:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226094336:0@lo:400:kworker.0 00000100:00100000:3.0:1788592935.228719:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592935.228731:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226094848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592935.228773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592935.228818:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093824 00000100:00100000:3.0:1788592935.228823:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093824 00000100:00100000:3.0:1788592935.228848:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093440 00000100:00100000:3.0:1788592935.228850:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093440 00000100:00100000:3.0:1788592935.228865:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788592935.228871:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226093824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592935.228905:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226093824:12345-0@lo:400:kworker.0 Request processed in 34us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592935.228918:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788592935.228932:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592935.228938:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226093440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592935.228967:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226093440:12345-0@lo:400:kworker.0 Request processed in 29us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592935.228973:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592935.228994:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094848 00000100:00100000:3.0:1788592935.228997:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094848 00000100:00100000:3.0:1788592935.229021:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592935.229027:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226094848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592935.229044:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788592935.229120:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226094848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592935.229126:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592935.229161:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788592935.229181:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226094848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788592935.229209:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000100:00100000:3.0:1788592935.229362:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226093184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592935.229582:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226094080:0@lo:400:kworker.0 00000100:00100000:1.0:1788592935.229685:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226093312 00000100:00100000:1.0:1788592935.229691:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226093312 00000100:00100000:1.0:1788592935.229736:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788592935.229744:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226093312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592935.229787:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226093312:12345-0@lo:400:kworker.0 Request processed in 44us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592935.229793:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788592935.230020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226093440:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.230031:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226093312:0@lo:400:kworker.0 00000100:00100000:0.0:1788592935.230042:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187c485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226093824:0@lo:400:kworker.0 00000040:00080000:2.0:1788592935.994974:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788592936.136242:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592936.382612:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.385056:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246208 00000100:00100000:2.0:1788592936.385173:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246208 00000100:00100000:2.0:1788592936.385411:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 145 00000100:00100000:2.0:1788592936.385423:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:2396:x1875475209246208:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.386117:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:2396:x1875475209246208:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 693us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.386126:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 145 00000100:00100000:2.0:1788592936.393967:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394030:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394103:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394129:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394151:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394193:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394210:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394249:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592936.394282:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246720 00000100:00100000:2.0:1788592936.394291:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246720 00000100:00100000:2.0:1788592936.394350:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247232 00000100:00100000:2.0:1788592936.394353:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247232 00000100:00100000:2.0:1788592936.394368:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246592 00000100:00100000:2.0:1788592936.394370:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246592 00000100:00100000:2.0:1788592936.394381:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247104 00000100:00100000:2.0:1788592936.394383:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247104 00000100:00100000:2.0:1788592936.394399:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592936.394409:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187deb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209246720:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.394547:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187deb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209246720:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 139us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.394555:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:2.0:1788592936.394743:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:2.0:1788592936.394751:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2396:x1875475209247232:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.394778:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2396:x1875475209247232:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.394784:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:2.0:1788592936.394879:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:2.0:1788592936.394886:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209246592:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.394912:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209246592:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.394919:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:2.0:1788592936.394941:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:2.0:1788592936.394948:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209247104:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.394972:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209247104:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.394978:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:2.0:1788592936.394997:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246464 00000100:00100000:2.0:1788592936.395001:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246464 00000100:00100000:2.0:1788592936.395023:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246976 00000100:00100000:2.0:1788592936.395026:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246976 00000100:00100000:2.0:1788592936.395036:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246336 00000100:00100000:2.0:1788592936.395038:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246336 00000100:00100000:2.0:1788592936.395048:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209246848 00000100:00100000:2.0:1788592936.395050:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209246848 00000100:00100000:2.0:1788592936.395061:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:2.0:1788592936.395091:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209246464:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.395118:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209246464:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 51us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.395124:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:2.0:1788592936.395135:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:2.0:1788592936.395140:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2396:x1875475209246976:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.395161:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2396:x1875475209246976:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 21us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.395166:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:2.0:1788592936.395176:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:2.0:1788592936.395182:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+6:2395:x1875475209246336:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.395201:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+6:2395:x1875475209246336:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 20us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.395213:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:2.0:1788592936.395225:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:2.0:1788592936.395231:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:2395:x1875475209246848:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592936.395256:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:2395:x1875475209246848:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 25us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592936.395261:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00080000:2.0:1788592936.395284:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592936.395288:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592936.395290:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592936.395292:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788592936.763690:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83 00000001:00100000:2.0:1788592936.771615:0:17160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4ec773d5-3e7f-4fd1-b1ce-72f04c95df83 00010000:00010000:0.0:1788592937.144839:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592937.283552:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592937.283578:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226094976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592937.283655:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592937.283718:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226094976 00000100:00100000:2.0:1788592937.283726:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226094976 00000100:00100000:2.0:1788592937.283780:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592937.283792:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226094976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592937.283821:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788592937.283866:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226094976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592937.283873:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788592937.283891:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592937.283922:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226094976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788592938.177454:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592938.299851:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592938.299877:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226095104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788592938.299949:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592938.301482:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226095104 00000100:00100000:0.0:1788592938.301494:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226095104 00000100:00080000:2.0:1788592938.301742:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592938.302379:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592938.302399:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226095104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788592938.302431:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788592938.302534:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226095104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592938.302542:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592938.302745:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226095104:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1788592938.538721:0:20204:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc500e9060 20000000:00000080:0.0:1788592938.538740:0:20204:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92187c4ad800 uarg=0000000000000000 20000000:01000000:0.0:1788592938.538781:0:20204:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788592938.538786:0:20204:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788592938.538791:0:20204:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788592938.541491:0:20205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788592938.541651:0:20204:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788592938.556740:0:20204:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788592938.556772:0:20204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.556809:0:20204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6024 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557485:0:20204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6032 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557492:0:20204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db6071 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557497:0:20204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557517:0:20204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557523:0:20204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557530:0:20204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557585:0:20204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557601:0:20204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.557615:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095232:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592938.557734:0:20204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557751:0:20204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.557761:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095360:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592938.557795:0:20204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557803:0:20204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 23 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.557811:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095488:0@lo:104: 00000100:00100000:3.0:1788592938.557859:0:20204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592938.557899:0:20204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db6071 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.557906:0:20204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db6071 expref: 23 pid: 17174 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.557914:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095616:0@lo:104: 00000100:00100000:3.0:1788592938.557936:0:20204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592938.557980:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226095488 00000100:00100000:3.0:1788592938.557988:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226095488 00000100:00100000:3.0:1788592938.558026:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226095616 00000100:00100000:3.0:1788592938.558029:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226095616 00000100:00100000:3.0:1788592938.558043:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788592938.558052:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+4:20204:x1875475226095488:12345-0@lo:104: 00010000:00010000:3.0:1788592938.558064:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.558140:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592938.558146:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+4:20204:x1875475226095488:12345-0@lo:104: Request processed in 95us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592938.558152:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788592938.558168:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788592938.558174:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:20204:x1875475226095616:12345-0@lo:104: 00010000:00010000:3.0:1788592938.558180:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.558210:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592938.558215:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:20204:x1875475226095616:12345-0@lo:104: Request processed in 42us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592938.558220:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788592938.558251:0:20204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db6032 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.558259:0:20204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db6032 expref: 23 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558267:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095744:0@lo:104: 00000100:00100000:3.0:1788592938.558287:0:20204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592938.558305:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226095744 00000100:00100000:3.0:1788592938.558309:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226095744 00010000:00010000:0.0:1788592938.558316:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592938.558323:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558325:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592938.558330:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:20204:x1875475226095744:12345-0@lo:104: 00010000:00010000:0.0:1788592938.558331:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92188205f200 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592938.558335:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.558337:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558344:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592938.558352:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592938.558358:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592938.558375:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592938.558380:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:20204:x1875475226095744:12345-0@lo:104: Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592938.558385:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788592938.558385:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558401:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592938.558410:0:20204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd314a3362db6024 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.558418:0:20204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd314a3362db6024 expref: 23 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558418:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558425:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92188205f200/0xbd314a3362db61d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db61dd expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558427:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226096000:0@lo:104: 00010000:00010000:0.0:1788592938.558442:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592938.558445:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558448:0:20204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592938.558451:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185820fc00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592938.558454:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558461:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558464:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096000 00000100:00100000:3.0:1788592938.558467:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096000 10000000:00010000:0.0:1788592938.558467:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592938.558472:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788592938.558482:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788592938.558486:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558487:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:20204:x1875475226096000:12345-0@lo:104: 00010000:00010000:0.0:1788592938.558491:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592938.558494:0:17163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558502:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558508:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185820fc00/0xbd314a3362db6071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6078 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.558518:0:17163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592938.558522:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:70647b28-81c8-4371-870a-35a99a7dd483+3:20204:x1875475226096000:12345-0@lo:104: Request processed in 36us (74us total) trans 0 rc 0/0 00010000:00010000:0.0:1788592938.558522:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592938.558526:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558528:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788592938.558531:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b800 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592938.558534:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558541:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558544:0:20204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218460bda80 going to sleep for 11 seconds 10000000:00010000:0.0:1788592938.558547:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592938.558552:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788592938.558563:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d508e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095488:0@lo:104: 00010000:00010000:0.0:1788592938.558564:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558569:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788592938.558571:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095616:0@lo:104: 00010000:00010000:0.0:1788592938.558575:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558577:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095744:0@lo:104: 00010000:00010000:0.0:1788592938.558582:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185022b800/0xbd314a3362db6032 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db6039 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592938.558591:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226096000:0@lo:104: 00010000:00010000:0.0:1788592938.558591:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592938.558594:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558606:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022bc00 already unused, calling callback (ffffffffc13bfc20) 10000000:00010000:0.0:1788592938.558609:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558615:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592938.558620:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592938.558636:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592938.558650:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558655:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592938.558661:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558667:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.147@tcp lock: ffff92185022bc00/0xbd314a3362db6024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd314a3362db602b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.558680:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592938.558682:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592938.558683:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592938.559114:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226096384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592938.559188:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592938.559194:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226095872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559214:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592938.559244:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226096128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559265:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592938.559281:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592938.559286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226096256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592938.559323:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096384 00000100:00100000:2.0:1788592938.559327:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096384 00010000:00010000:2.0:1788592938.559350:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6024 expref: 24 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592938.559363:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226095872 00000100:00100000:2.0:1788592938.559365:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226095872 00010000:00010000:2.0:1788592938.559374:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 25 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592938.559383:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096128 00000100:00100000:2.0:1788592938.559385:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096128 00010000:00010000:2.0:1788592938.559394:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6071 expref: 26 pid: 17174 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592938.559404:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096256 00000100:00100000:2.0:1788592938.559406:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096256 00010000:00010000:2.0:1788592938.559417:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6032 expref: 27 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592938.559445:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592938.559451:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+27:3639:x1875475226096384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592938.559463:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592938.559468:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6024 expref: 27 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559477:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db6024 expref: 27 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559489:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185022b600/0xbd314a3362db602b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db6024 expref: 27 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559501:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592938.559532:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+26:3639:x1875475226096384:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592938.559538:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592938.559551:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592938.559557:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+25:3639:x1875475226095872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592938.559564:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592938.559568:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 25 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559575:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 25 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559584:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921875b80800/0xbd314a3362db61dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db61d6 expref: 25 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559604:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592938.559637:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+24:3639:x1875475226095872:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592938.559642:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592938.559655:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592938.559661:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+23:3641:x1875475226096128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592938.559669:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592938.559673:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6071 expref: 23 pid: 17174 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559680:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db6071 expref: 23 pid: 17174 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559689:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185022a800/0xbd314a3362db6078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db6071 expref: 23 pid: 17174 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559696:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592938.559721:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+22:3641:x1875475226096128:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592938.559726:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592938.559737:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592938.559742:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+21:3641:x1875475226096256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592938.559748:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592938.559752:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd314a3362db6032 expref: 21 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559760:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd314a3362db6032 expref: 21 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559777:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185022a200/0xbd314a3362db6039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd314a3362db6032 expref: 21 pid: 17172 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592938.559786:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592938.559806:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70647b28-81c8-4371-870a-35a99a7dd483+20:3641:x1875475226096256:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592938.559812:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592938.559838:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226096256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559847:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226096128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559869:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226095872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592938.559876:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:70647b28-81c8-4371-870a-35a99a7dd483:3639:1875475226096384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592938.562281:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592938.562291:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592938.567272:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592938.567642:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247360 00000100:00100000:0.0:1788592938.567654:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247360 00010000:00010000:0.0:1788592938.567695:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 13 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592938.567737:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 13 00000100:00100000:0.0:1788592938.567762:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921848c09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56318202-5ccc-4b18-bf05-3f29008f5167+13:2396:x1875475209247360:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592938.567777:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592938.567784:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 13 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.567797:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 13 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.567816:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592938.567871:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921848c09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56318202-5ccc-4b18-bf05-3f29008f5167+13:2396:x1875475209247360:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 112us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592938.567878:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 13 00010000:00010000:3.0:1788592938.569277:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92185022b200/0xbd314a3362db6365 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c321a expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592938.569286:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592938.569298:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095232:192.168.203.47@tcp:104: 00000100:00100000:3.0:1788592938.569309:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186d509f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20204:1875475226095360:192.168.203.47@tcp:104: 00010000:00010000:3.0:1788592938.569345:0:20204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592938.569381:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247488 00000100:00100000:0.0:1788592938.569386:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247488 00010000:00010000:0.0:1788592938.569410:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592938.569443:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 14 00000100:00100000:0.0:1788592938.569450:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56318202-5ccc-4b18-bf05-3f29008f5167+12:2395:x1875475209247488:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592938.569460:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592938.569465:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569474:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569488:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9217439f1800/0xbd314a3362db6326 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31aa expref: 12 pid: 17175 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569514:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569522:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569537:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569545:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569552:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569559:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569564:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841495000 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592938.569569:0:17166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569578:0:17166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569590:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592938.569599:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592938.569645:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56318202-5ccc-4b18-bf05-3f29008f5167+11:2395:x1875475209247488:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 194us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592938.569658:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 14 00010000:00010000:3.0:1788592938.570365:0:20204:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.570376:0:20204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592938.570382:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff921841495000/0xbd314a3362db6396 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592939.192315:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592939.324823:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226096512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592939.324889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592939.324997:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096512 00000100:00100000:1.0:1788592939.325005:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096512 00000100:00100000:1.0:1788592939.325057:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788592939.325091:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226096512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592939.325121:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788592939.325164:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226096512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592939.325171:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592939.325299:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226096512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788592939.332314:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592939.338854:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226096640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592939.338920:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592939.341246:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096640 00000100:00100000:1.0:1788592939.341258:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096640 00000100:00100000:1.0:1788592939.341356:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788592939.341367:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226096640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788592939.341403:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788592939.341571:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226096640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 205us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592939.341580:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788592939.341631:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226096640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788592940.216786:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592940.344300:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592940.344329:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226096896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592940.344392:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.344434:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592940.344442:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226096768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592940.344464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.344507:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096896 00000100:00100000:2.0:1788592940.344515:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096896 00000100:00100000:2.0:1788592940.344555:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226096768 00000100:00100000:2.0:1788592940.344557:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226096768 00000100:00100000:2.0:1788592940.344574:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592940.344582:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226096896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592940.344609:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788592940.344660:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875475226096896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.344668:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592940.344681:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592940.344686:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226096768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788592940.344694:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788592940.344717:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226096768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.344729:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788592940.344745:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592940.344778:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226096768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788592940.344914:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70647b28-81c8-4371-870a-35a99a7dd483:3640:1875475226097024:0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.344942:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592940.344988:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226097408:0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.345026:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592940.345049:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226097920:0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.345110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.345249:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226097536:0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.345278:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.345292:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226098048:0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.345731:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097536 00000100:00100000:1.0:1788592940.345737:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097536 00000100:00100000:1.0:1788592940.345772:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788592940.345780:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226097536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.345820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592940.345831:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226097536:12345-0@lo:400:kworker.0 Request processed in 51us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.345839:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592940.345856:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226097536:0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.345885:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097408 00000100:00100000:2.0:1788592940.345895:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097408 00000100:00100000:2.0:1788592940.345925:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097920 00000100:00100000:2.0:1788592940.345928:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097920 00000100:00100000:2.0:1788592940.345943:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098048 00000100:00100000:2.0:1788592940.345945:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098048 00000100:00100000:2.0:1788592940.345957:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592940.345962:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226097408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.345995:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875475226097408:12345-0@lo:400:kworker.0 Request processed in 33us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.346001:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788592940.346012:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592940.346017:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226097920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.346037:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875475226097920:12345-0@lo:400:kworker.0 Request processed in 21us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.346043:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592940.346051:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592940.346153:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226097280:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346184:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.346203:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226097792:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346220:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.346229:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226098304:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346245:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.346256:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788592940.346260:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226097152:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346287:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.346445:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226097664:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.346490:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226098176:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.346532:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097280 00000100:00100000:0.0:1788592940.346535:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097280 00000100:00100000:3.0:1788592940.346541:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097024 00000100:00100000:3.0:1788592940.346548:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097024 00000100:00100000:0.0:1788592940.346564:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097664 00000100:00100000:0.0:1788592940.346568:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097664 00000100:00100000:0.0:1788592940.346591:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592940.346596:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226097280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346639:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226097280:12345-0@lo:400:kworker.0 Request processed in 42us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.346644:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592940.346657:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592940.346662:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226097664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.346691:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226097664:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.346696:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592940.346720:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097792 00000100:00100000:1.0:1788592940.346725:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097792 00000100:00100000:1.0:1788592940.346744:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098304 00000100:00100000:1.0:1788592940.346746:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098304 00000100:00100000:1.0:1788592940.346758:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098176 00000100:00100000:1.0:1788592940.346761:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098176 00000100:00100000:1.0:1788592940.346774:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788592940.346781:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.346816:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875475226097792:12345-0@lo:400:kworker.0 Request processed in 35us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.346822:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788592940.346834:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788592940.346841:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226098304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.346905:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875475226098304:12345-0@lo:400:kworker.0 Request processed in 66us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.346912:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788592940.346924:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788592940.346930:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226098176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.346967:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875475226098176:12345-0@lo:400:kworker.0 Request processed in 37us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.346973:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592940.347525:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788592940.347534:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:3640:x1875475226097024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592940.347800:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+20:3640:x1875475226097024:12345-0@lo:400:kworker.0 Request processed in 57us (2645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592940.347808:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788592940.347961:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226098048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.347994:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875475226098048:12345-0@lo:400:kworker.0 Request processed in 1938us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.348000:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788592940.348028:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592940.348033:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788592940.348035:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592940.348094:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875475226097408:0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.348106:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1875475226097920:0@lo:400:kworker.0 00000100:00100000:2.0:1788592940.348139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1875475226096896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592940.348170:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:70647b28-81c8-4371-870a-35a99a7dd483:3640:1875475226097024:0@lo:400:kworker.0 00010000:00080000:2.0:1788592940.348182:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92174360ed80 x1875475226098048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592940.348193:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1875475226098048:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.348585:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226097152 00000100:00100000:0.0:1788592940.348590:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226097152 00000100:00100000:0.0:1788592940.348637:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592940.348645:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226097152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.348691:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226097152:12345-0@lo:400:kworker.0 Request processed in 48us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.348696:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592940.348733:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226097152:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.348747:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226097664:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.348757:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1875475226098176:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.348768:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226097280:0@lo:400:kworker.0 00000100:00100000:0.0:1788592940.348781:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875475226097792:0@lo:400:kworker.0 00010000:00080000:0.0:1788592940.348793:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff921744779500 x1875475226098304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592940.348803:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1875475226098304:0@lo:400:kworker.0 00000100:00100000:1.0:1788592940.472725:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592940.473182:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247616 00000100:00100000:2.0:1788592940.473192:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247616 00000100:00100000:2.0:1788592940.473454:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 147 00000100:00100000:2.0:1788592940.473467:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+11:14905:x1875475209247616:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592940.473484:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592940.473504:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921875b80800/0xbd314a3362db639d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3252 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.473538:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921875b80800/0xbd314a3362db639d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3252 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.473551:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921875b80800/0xbd314a3362db639d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3252 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.473561:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b80800, rc 0) 00000100:00100000:2.0:1788592940.473632:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+12:14905:x1875475209247616:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 167us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.473641:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 147 10000000:01000000:1.0:1788592940.476492:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592940.476498:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff921852d44000 from 13 10000000:01000000:1.0:1788592940.476501:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592940.476539:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592940.476550:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592940.476561:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592940.476584:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.476648:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592940.476682:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592940.476791:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098432 00000100:00100000:1.0:1788592940.476796:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098432 00000100:00100000:1.0:1788592940.476834:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788592940.476841:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+20:17177:x1875475226098432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592940.476860:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592940.476872:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92185022b200/0xbd314a3362db63ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db63a4 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592940.476894:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92185022b200/0xbd314a3362db63ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db63a4 expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592940.476904:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92185022b200/0xbd314a3362db63ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db63a4 expref: 21 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592940.476923:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92185022b200, rc 0) 00000100:00100000:1.0:1788592940.476955:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226098432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.476962:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788592940.477000:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592940.477012:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592940.477021:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db63ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592940.477102:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.477293:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592940.477316:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592940.479298:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592940.479493:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098560 00000100:00100000:1.0:1788592940.479501:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098560 00000100:00100000:1.0:1788592940.479543:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247744 00000100:00100000:1.0:1788592940.479546:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247744 00000100:00100000:1.0:1788592940.479573:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788592940.479582:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226098560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.479720:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226098560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.479727:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788592940.479751:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 150 00000100:00100000:1.0:1788592940.479757:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+12:14905:x1875475209247744:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.479813:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56318202-5ccc-4b18-bf05-3f29008f5167+12:14905:x1875475209247744:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 56us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.479820:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 150 00000100:00100000:1.0:1788592940.479937:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.479979:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.480020:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592940.480044:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592940.480055:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098688 00000100:00100000:1.0:1788592940.480058:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098688 00000100:00100000:1.0:1788592940.480105:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788592940.483042:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226098688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592940.484023:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226098688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 992us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592940.484034:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788592940.484131:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.484557:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592940.484651:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209247872 00000100:00100000:0.0:1788592940.484658:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209247872 00000100:00100000:0.0:1788592940.484698:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 152 00000100:00100000:0.0:1788592940.484706:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+12:14905:x1875475209247872:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.484801:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+12:14905:x1875475209247872:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 93us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.484810:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 152 00000040:00080000:1.0:1788592940.486537:0:20303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788592940.486733:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788592940.486759:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592940.486770:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.486782:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff92185022a800/0xbd314a3362db63a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592940.486792:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592940.486795:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92186f49a000 from 13 10000000:01000000:0.0:1788592940.486798:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592940.486831:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.486839:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.486848:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592940.486870:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.486921:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.486960:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9218767c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592940.486973:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098816 00000100:00100000:3.0:1788592940.486980:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098816 00000100:00100000:3.0:1788592940.487020:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788592940.487029:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+21:17177:x1875475226098816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592940.487038:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592940.487050:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841495800/0xbd314a3362db63b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db63b2 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.487093:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495800/0xbd314a3362db63b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db63b2 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.487105:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841495800/0xbd314a3362db63b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db63b2 expref: 22 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.487114:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841495800, rc 0) 00000100:00100000:3.0:1788592940.487216:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226098816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592940.487223:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788592940.487266:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592940.487279:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.487288:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db63b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592940.487343:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.487383:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592940.487404:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592940.487424:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226098944 00000100:00100000:3.0:1788592940.487428:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226098944 00000100:00100000:3.0:1788592940.487454:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788592940.487461:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226098944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.487562:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226098944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592940.487570:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788592940.487605:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226098944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.488745:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.488803:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592940.488841:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671900 going to sleep for 11 seconds 00000100:00100000:0.0:1788592940.488892:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099072 00000100:00100000:0.0:1788592940.488898:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099072 00000100:00100000:0.0:1788592940.488950:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788592940.488966:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226099072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.489083:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226099072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.489099:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788592940.489161:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788592940.494858:0:20305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788592940.495136:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788592940.495159:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592940.495170:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.495202:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff9217439f0800/0xbd314a3362db63b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592940.495212:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592940.495215:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9218758fa000 from 13 10000000:01000000:2.0:1788592940.495217:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592940.495251:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.495259:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.495269:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592940.495291:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.495347:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.495394:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592940.495468:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099200 00000100:00100000:0.0:1788592940.495477:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099200 00000100:00100000:0.0:1788592940.495526:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788592940.495537:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+22:17177:x1875475226099200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592940.495549:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592940.495563:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9217439f0000/0xbd314a3362db63c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db63c0 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.495585:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9217439f0000/0xbd314a3362db63c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db63c0 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.495597:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9217439f0000/0xbd314a3362db63c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db63c0 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.495606:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0000, rc 0) 00000100:00100000:0.0:1788592940.495664:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226099200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.495672:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788592940.495979:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592940.495993:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592940.496002:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db63c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592940.496052:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.496240:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.496266:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592940.496307:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099328 00000100:00100000:0.0:1788592940.496312:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099328 00000100:00100000:0.0:1788592940.496338:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788592940.496345:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226099328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.496465:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226099328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592940.496478:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788592940.496940:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.496970:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.497007:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592940.497028:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592940.497377:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099456 00000100:00100000:3.0:1788592940.497384:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099456 00000100:00100000:3.0:1788592940.497423:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788592940.497432:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226099456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.497538:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226099456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592940.497546:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788592940.497750:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592940.497851:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248000 00000100:00100000:3.0:1788592940.497855:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248000 00000100:00100000:3.0:1788592940.497890:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 159 00000100:00100000:3.0:1788592940.497897:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+12:14905:x1875475209248000:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592940.497905:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592940.497924:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841495000/0xbd314a3362db63ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3259 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.497946:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841495000/0xbd314a3362db63ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3259 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.497957:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841495000/0xbd314a3362db63ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3259 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.497966:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841495000, rc 0) 00000100:00100000:3.0:1788592940.498003:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:14905:x1875475209248000:12345-192.168.203.47@tcp:101:ll_cfg_requeue.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592940.498010:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 159 00000100:00100000:1.0:1788592940.499345:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92174477b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788592940.500592:0:20306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788592940.500776:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788592940.500801:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592940.500811:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.500822:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921875b80600/0xbd314a3362db63c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592940.500832:0:17177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788592940.500835:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92174444b000 from 13 10000000:01000000:3.0:1788592940.500838:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592940.500868:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.500876:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.500886:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592940.500917:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.500973:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592940.501021:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba31780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592940.501227:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592940.501298:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099584 00000100:00100000:3.0:1788592940.501305:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099584 00000100:00100000:3.0:1788592940.501360:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248128 00000100:00100000:3.0:1788592940.501363:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248128 00000100:00100000:3.0:1788592940.501381:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788592940.501389:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+23:17177:x1875475226099584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592940.501400:0:17175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592940.501412:0:17175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff921841494200/0xbd314a3362db63dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd314a3362db63d5 expref: -99 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592940.501424:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 161 00010000:00010000:3.0:1788592940.501435:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff921841494200/0xbd314a3362db63dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd314a3362db63d5 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592940.501437:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:14905:x1875475209248128:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 00010000:00010000:3.0:1788592940.501454:0:17175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff921841494200/0xbd314a3362db63dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd314a3362db63d5 expref: 24 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592940.501462:0:17175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921841494200, rc 0) 00000100:00100000:3.0:1788592940.501499:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226099584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592940.501506:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788592940.501549:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.501559:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:14905:x1875475209248128:12345-192.168.203.47@tcp:501:ll_cfg_requeue.0 Request processed in 125us (331us total) trans 0 rc 0/0 00010000:00010000:3.0:1788592940.501564:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63dc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592940.501569:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 161 00010000:00010000:3.0:1788592940.501589:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd314a3362db63dc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592940.501664:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592940.501695:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592940.501719:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff921876671480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592940.502048:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099712 00000100:00100000:2.0:1788592940.502053:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099712 00000100:00100000:2.0:1788592940.502103:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788592940.502337:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226099712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.502417:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226099712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.502424:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788592940.502449:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186f487480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.502481:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592940.502524:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592940.502551:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184384a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592940.502602:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226099840 00000100:00100000:2.0:1788592940.502606:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226099840 00000100:00100000:2.0:1788592940.502706:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788592940.502715:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226099840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.502796:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:17177:x1875475226099840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.502803:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788592940.502949:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:70647b28-81c8-4371-870a-35a99a7dd483:17177:1875475226099840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788592940.512938:0:20307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788592940.513049:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788592940.513369:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592940.513379:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63dc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592940.513391:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.147@tcp lock: ffff921841495200/0xbd314a3362db63d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd314a3362db63dc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592940.514090:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592940.514647:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248256 00000100:00100000:2.0:1788592940.514657:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248256 00000100:00100000:2.0:1788592940.514704:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 164 00000100:00100000:2.0:1788592940.514713:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:14905:x1875475209248256:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592940.514838:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:14905:x1875475209248256:12345-192.168.203.47@tcp:503:ll_cfg_requeue.0 Request processed in 125us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592940.514851:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 164 00010000:00010000:1.0:1788592941.241893:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592941.498774:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.498816:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.498841:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.498865:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.498889:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592941.498889:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248384 00000100:00100000:0.0:1788592941.498901:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248384 00000100:00100000:2.0:1788592941.498909:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.498932:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.498953:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248512 00000100:00100000:2.0:1788592941.498958:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248512 00000100:00100000:0.0:1788592941.498967:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 165 00000100:00100000:0.0:1788592941.498978:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:2395:x1875475209248384:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592941.498996:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248640 00000100:00100000:2.0:1788592941.499001:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248640 00000100:00100000:2.0:1788592941.499013:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249152 00000100:00100000:2.0:1788592941.499015:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249152 00000100:00100000:2.0:1788592941.499029:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:2.0:1788592941.499037:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+6:2396:x1875475209248512:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592941.499137:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+6:2396:x1875475209248512:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592941.499138:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56318202-5ccc-4b18-bf05-3f29008f5167+13:2395:x1875475209248384:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 156us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592941.499150:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:0.0:1788592941.499155:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 165 00000100:00100000:2.0:1788592941.499171:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:0.0:1788592941.499192:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248768 00000100:00100000:0.0:1788592941.499197:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248768 00000100:00100000:0.0:1788592941.499222:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209248896 00000100:00100000:0.0:1788592941.499226:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209248896 00000100:00100000:0.0:1788592941.499248:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249408 00000100:00100000:0.0:1788592941.499252:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249408 00000100:00100000:3.0:1788592941.499257:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:3.0:1788592941.499268:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209248768:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592941.499275:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:0.0:1788592941.499286:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209248896:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592941.499301:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209248768:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592941.499308:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:3.0:1788592941.499326:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:0.0:1788592941.499326:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209248896:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 39us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592941.499335:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209249408:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592941.499341:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:3.0:1788592941.499361:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209249408:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592941.499368:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00080000:3.0:1788592941.499405:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592941.499409:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592941.499412:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788592941.499414:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592941.499483:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209248640:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:2.0:1788592941.499506:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209248640:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 26us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592941.502688:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:3.0:1788592941.502708:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209249152:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592941.502834:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209249152:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 133us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592941.502860:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:3.0:1788592941.502954:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592941.503239:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249024 00000100:00100000:1.0:1788592941.503248:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249024 00000100:00100000:1.0:1788592941.503285:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1788592941.503291:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2396:x1875475209249024:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592941.503318:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2396:x1875475209249024:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592941.503324:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00080000:1.0:1788592941.503358:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592941.503903:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:2.0:1788592941.504432:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592941.504491:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249280 00000100:00100000:1.0:1788592941.504496:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249280 00000100:00100000:1.0:1788592941.504541:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:1.0:1788592941.504548:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2396:x1875475209249280:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592941.504581:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92174360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2396:x1875475209249280:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592941.504587:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00080000:3.0:1788592941.505262:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592941.968531:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592941.968695:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249536 00000100:00100000:0.0:1788592941.968705:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249536 00000100:00100000:0.0:1788592941.968768:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:0.0:1788592941.968778:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+6:15569:x1875475209249536:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592941.968797:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592941.968819:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db63e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3260 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.968890:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.968915:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.968951:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.968965:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.968972:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.968979:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969056:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db63f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969106:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969115:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592941.969156:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592941.969160:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592941.969199:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969210:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969216:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969231:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969237:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592941.969241:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969248:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969260:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:0.0:1788592941.969263:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592941.969267:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969274:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db63ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969287:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969293:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969299:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969304:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592941.969307:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969322:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969330:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff921875ae0800) 00010000:00010000:0.0:1788592941.969333:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592941.969336:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969342:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db63f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969383:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db63e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3260 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969396:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0e00/0xbd314a3362db63f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3260 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592941.969404:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff921875ae0500) 00010000:00010000:0.0:1788592941.969406:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592941.969408:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0e00, rc 0) 00000100:00100000:0.0:1788592941.969467:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+7:15569:x1875475209249536:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 690us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592941.969474:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 23 00000100:00100000:3.0:1788592941.985906:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592941.986120:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249664 00000100:00100000:2.0:1788592941.986145:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249664 00000100:00100000:2.0:1788592941.986222:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:2.0:1788592941.986233:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1b09db4-0481-49f3-89da-591dd9a69226+7:15569:x1875475209249664:12345-192.168.203.47@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788592941.986317:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1b09db4-0481-49f3-89da-591dd9a69226+7:15569:x1875475209249664:12345-192.168.203.47@tcp:900:lhsmtool_posix.0 Request processed in 85us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592941.986325:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:2.0:1788592941.999791:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592941.999868:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209249920 00000100:00100000:0.0:1788592941.999879:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209249920 00000100:00100000:0.0:1788592941.999953:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:0.0:1788592941.999965:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+7:15569:x1875475209249920:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592942.000008:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.000029:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db63ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3267 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000421:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000436:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000448:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000509:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000517:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000525:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000665:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db6414 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000673:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db6414 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000681:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db6414 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.000691:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788592942.000853:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000862:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000868:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000874:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.000879:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000886:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.000897:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff921875ae0500) 00010000:00010000:0.0:1788592942.000900:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.001493:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001504:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6406 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001520:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001526:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001532:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001560:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.001564:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001570:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001580:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff921875ae0800) 00010000:00010000:0.0:1788592942.001583:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.001586:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.001592:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db640d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.002818:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db63ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3267 expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.002839:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1000/0xbd314a3362db6414 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3267 expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.002848:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921875ae0000) 00010000:00010000:0.0:1788592942.002852:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.002855:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1000, rc 0) 00000100:00100000:0.0:1788592942.002937:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+9:15569:x1875475209249920:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 2974us (3155us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788592942.002946:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 24 00000100:00100000:1.0:1788592942.009856:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.011354:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250048 00000100:00100000:0.0:1788592942.011393:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250048 00000100:00100000:0.0:1788592942.011465:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:0.0:1788592942.011476:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+9:15569:x1875475209250048:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788592942.011598:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+9:15569:x1875475209250048:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 Request processed in 123us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.011614:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 25 00000100:00100000:3.0:1788592942.018598:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592942.018781:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250176 00000100:00100000:2.0:1788592942.018791:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250176 00000100:00100000:2.0:1788592942.018853:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1788592942.018864:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+5:15569:x1875475209250176:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788592942.020478:0:17179:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1571us 00000100:00100000:3.0:1788592942.043841:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+5:15569:x1875475209250176:12345-192.168.203.47@tcp:59:lhsmtool_posix.0 Request processed in 24970us (25245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592942.043857:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1788592942.109996:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.110122:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250304 00000100:00100000:0.0:1788592942.110132:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250304 00000100:00100000:0.0:1788592942.110204:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:0.0:1788592942.110215:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+9:15575:x1875475209250304:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592942.110235:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.110254:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db6422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c326e expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110316:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110332:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110343:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110408:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110416:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110433:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110490:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110499:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110506:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110512:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.110517:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110525:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110547:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:0.0:1788592942.110551:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.110556:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110562:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db6429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110575:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110582:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110589:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110609:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.110613:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110620:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110628:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff921875ae0800) 00010000:00010000:0.0:1788592942.110631:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.110634:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110639:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6430 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110670:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db6422 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c326e expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110680:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:0.0:1788592942.110682:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.110686:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db6422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c326e expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.110695:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f0c00, rc 0) 00000100:00100000:0.0:1788592942.110753:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+9:15575:x1875475209250304:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 540us (766us total) trans 0 rc 301/301 00000100:00100000:0.0:1788592942.110759:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:1.0:1788592942.123010:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.126423:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250432 00000100:00100000:0.0:1788592942.126453:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250432 00000100:00100000:0.0:1788592942.126579:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:0.0:1788592942.126591:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1b09db4-0481-49f3-89da-591dd9a69226+9:15575:x1875475209250432:12345-192.168.203.47@tcp:700:lfs.0 00000100:00100000:0.0:1788592942.126695:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1b09db4-0481-49f3-89da-591dd9a69226+9:15575:x1875475209250432:12345-192.168.203.47@tcp:700:lfs.0 Request processed in 106us (3694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.126703:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:1.0:1788592942.134127:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592942.134321:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250688 00000100:00100000:2.0:1788592942.134330:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250688 00000100:00100000:2.0:1788592942.134393:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:2.0:1788592942.134404:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+9:15575:x1875475209250688:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:2.0:1788592942.134461:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592942.134490:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b000/0xbd314a3362db6350 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c31db expref: 9 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.134514:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:2.0:1788592942.134519:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592942.134582:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.134597:0:17180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.134636:0:17180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.134667:0:17180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.134681:0:17180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 5 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592942.134695:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17180:1875475226099968:192.168.203.47@tcp:104: 00000100:00100000:2.0:1788592942.134778:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21600 going to sleep for 11 seconds 00000040:00080000:1.0:1788592942.136782:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788592942.144616:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.144735:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17180:1875475226099968:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592942.144764:0:17180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592942.144838:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250816 00000100:00100000:3.0:1788592942.144846:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250816 00010000:00010000:3.0:1788592942.144883:0:17166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 6 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592942.144934:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 15 00000100:00100000:3.0:1788592942.144944:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2396:x1875475209250816:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592942.144960:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592942.144967:0:17166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 6 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.144979:0:17166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 6 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145003:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db638f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c324b expref: 6 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145040:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:3.0:1788592942.145046:0:17166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145056:0:17166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145063:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145129:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592942.145327:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2396:x1875475209250816:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 382us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592942.145335:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 15 00010000:00010000:3.0:1788592942.145658:0:17180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145667:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145690:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145700:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.145707:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147523:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147545:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147554:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592942.147571:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e89b81e reply state 000000001270256d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147582:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147590:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:3.0:1788592942.147593:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592942.147598:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788592942.147614:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788592942.147621:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147628:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147634:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147639:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b80200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592942.147643:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147650:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147670:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9218765de500) 00010000:00010000:3.0:1788592942.147673:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592942.147677:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147683:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80200/0xbd314a3362db6437 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592942.147702:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e89b81e reply state 000000001270256d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147710:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.147716:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff921743721d00) 00010000:00010000:3.0:1788592942.147719:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788592942.147721:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788592942.147818:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+10:15575:x1875475209250688:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 13412us (13696us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788592942.147827:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00010000:00010000:0.0:1788592942.265874:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592942.315864:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.316201:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209250944 00000100:00100000:0.0:1788592942.316212:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209250944 00000100:00100000:0.0:1788592942.316281:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1788592942.316292:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+10:15583:x1875475209250944:12345-192.168.203.47@tcp:101:lctl.0 00010000:00010000:0.0:1788592942.316316:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.316340:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db644c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3275 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.316405:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6453 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.316419:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.316431:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.316475:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592942.316495:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592942.316535:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.316571:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db644c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3275 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.316589:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1800/0xbd314a3362db6453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3275 expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.316751:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:0.0:1788592942.316755:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592942.316759:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9217439f1800, rc 0) 00000100:00100000:0.0:1788592942.316824:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+11:15583:x1875475209250944:12345-192.168.203.47@tcp:101:lctl.0 Request processed in 533us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.316830:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:1.0:1788592942.346005:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.346142:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209251072 00000100:00100000:3.0:1788592942.346153:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209251072 00000100:00100000:3.0:1788592942.346313:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:3.0:1788592942.346325:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:15584:x1875475209251072:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592942.346352:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592942.346373:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db645a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c327c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.346444:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031c00/0xbd314a3362db6461 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.346474:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031c00/0xbd314a3362db6461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.346486:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031c00/0xbd314a3362db6461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592942.346528:0:17179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788592942.346532:0:17179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592942.346549:0:17179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921840031c00/0xbd314a3362db6461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.346570:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db645a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c327c expref: 7 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.346590:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031c00/0xbd314a3362db6461 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c327c expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.346609:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:3.0:1788592942.346613:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592942.346617:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840031c00, rc 0) 00000100:00100000:3.0:1788592942.348009:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15584:x1875475209251072:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1681us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592942.348018:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:1.0:1788592942.359116:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.359940:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209251200 00000100:00100000:0.0:1788592942.359951:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209251200 00000100:00100000:0.0:1788592942.360017:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:0.0:1788592942.360028:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:15584:x1875475209251200:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592942.360047:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.360093:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db6468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3283 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.360161:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.360176:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.360408:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.360484:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.360494:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.360502:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361392:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db647d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361405:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db647d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361413:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db647d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.361550:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592942.361554:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592942.361575:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db647d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361588:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361595:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361712:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361718:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f1600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.361723:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361731:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361745:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:0.0:1788592942.361749:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.361753:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361760:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f1600/0xbd314a3362db646f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361775:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361781:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361787:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361791:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9217439f0600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.361794:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361810:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361818:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff921743721d00) 00010000:00010000:0.0:1788592942.361820:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.361823:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361829:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0600/0xbd314a3362db6476 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361857:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9217439f0c00/0xbd314a3362db6468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3283 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361870:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db647d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3283 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.361877:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:0.0:1788592942.361879:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592942.361882:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838400, rc 0) 00000100:00100000:0.0:1788592942.361947:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:15584:x1875475209251200:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1921us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.361954:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:2.0:1788592942.366962:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.367518:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209251328 00000100:00100000:0.0:1788592942.367671:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209251328 00000100:00100000:0.0:1788592942.367819:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:0.0:1788592942.367830:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:15584:x1875475209251328:12345-192.168.203.47@tcp:900:lfs.0 00000100:00100000:0.0:1788592942.367935:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:15584:x1875475209251328:12345-192.168.203.47@tcp:900:lfs.0 Request processed in 107us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.367943:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:1.0:1788592942.378275:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.378495:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209251584 00000100:00100000:0.0:1788592942.378505:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209251584 00000100:00100000:0.0:1788592942.379790:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:0.0:1788592942.379805:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+7:15584:x1875475209251584:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592942.379824:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.379844:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c328a expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.379957:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788592942.380053:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6484 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c328a expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.380100:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:0.0:1788592942.380104:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592942.380118:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c328a expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.380134:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838600, rc 0) 00000100:00100000:0.0:1788592942.380206:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+8:15584:x1875475209251584:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 398us (1934us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788592942.380213:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:1.0:1788592942.383421:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.383573:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209251840 00000100:00100000:3.0:1788592942.383582:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209251840 00000100:00100000:3.0:1788592942.383648:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:3.0:1788592942.383658:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+8:15584:x1875475209251840:12345-192.168.203.47@tcp:36:lfs.0 00010000:00010000:3.0:1788592942.383709:0:18707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592942.383742:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838400/0xbd314a3362db647d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3283 expref: 8 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.383761:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:3.0:1788592942.383766:0:18707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592942.383787:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.383800:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.383809:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592942.383999:0:18707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064f00316 reply state 00000000676934a2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.384011:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.384017:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:3.0:1788592942.384019:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788592942.384022:0:18707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788592942.384028:0:18707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788592942.384881:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+9:15584:x1875475209251840:12345-192.168.203.47@tcp:36:lfs.0 Request processed in 1221us (1463us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788592942.384890:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 33 00000100:00100000:2.0:1788592942.387547:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.387643:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209252096 00000100:00100000:3.0:1788592942.387652:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209252096 00000100:00100000:3.0:1788592942.387740:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:3.0:1788592942.387750:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+9:15584:x1875475209252096:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1788592942.387965:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+10:15584:x1875475209252096:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 216us (426us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788592942.387973:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:1.0:1788592942.391525:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.391653:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209252352 00000100:00100000:3.0:1788592942.391664:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209252352 00000100:00100000:3.0:1788592942.391735:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:3.0:1788592942.391746:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+10:15584:x1875475209252352:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592942.391769:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592942.391790:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3291 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.391861:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.391875:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.391887:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.391897:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.391905:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.391922:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592942.392018:0:17179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788592942.392119:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392127:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392150:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392156:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592942.392161:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392714:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392730:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:3.0:1788592942.392733:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592942.392738:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392745:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392761:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392767:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392773:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392778:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592942.392781:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392799:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392808:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff921743721d00) 00010000:00010000:3.0:1788592942.392810:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592942.392813:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392819:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392858:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6499 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3291 expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392868:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:3.0:1788592942.392871:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592942.392874:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3291 expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.392883:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030600, rc 0) 00000100:00100000:3.0:1788592942.392954:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+11:15584:x1875475209252352:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1209us (1436us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788592942.392963:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 34 00000100:00100000:1.0:1788592942.396130:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.396221:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209252480 00000100:00100000:0.0:1788592942.396231:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209252480 00000100:00100000:0.0:1788592942.396290:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:0.0:1788592942.396318:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+11:15584:x1875475209252480:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592942.396339:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.396358:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db64b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3298 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.396461:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.396476:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.396489:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.396514:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788592942.396518:0:17181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592942.396536:0:17181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.396561:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db64b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.396578:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.396586:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:0.0:1788592942.396589:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592942.396592:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839c00, rc 0) 00000100:00100000:0.0:1788592942.396653:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+12:15584:x1875475209252480:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 337us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.396670:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 35 00000100:00100000:3.0:1788592942.400472:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592942.400547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592942.400626:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226100096 00000100:00100000:0.0:1788592942.400635:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226100096 00000100:00100000:0.0:1788592942.400696:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592942.400707:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226100096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592942.400740:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788592942.401394:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592942.402422:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226100096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1712us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.402433:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788592942.402846:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592942.403000:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592942.403325:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209252608 00000100:00100000:2.0:1788592942.403333:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209252608 00000100:00100000:2.0:1788592942.403414:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:2.0:1788592942.403424:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+12:15584:x1875475209252608:12345-192.168.203.47@tcp:37:lfs.0 00000100:00100000:3.0:1788592942.408553:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+12:15584:x1875475209252608:12345-192.168.203.47@tcp:37:lfs.0 Request processed in 5119us (5544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592942.408580:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 3 00000100:00100000:1.0:1788592942.412118:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.412337:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209252864 00000100:00100000:3.0:1788592942.412348:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209252864 00000100:00100000:3.0:1788592942.412408:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:3.0:1788592942.412417:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921875b7e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+12:15584:x1875475209252864:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1788592942.412657:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921875b7e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+13:15584:x1875475209252864:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 240us (547us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788592942.412666:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 4 00000100:00100000:1.0:1788592942.500324:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.500974:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209252992 00000100:00100000:3.0:1788592942.500984:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209252992 00000100:00100000:3.0:1788592942.501278:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:3.0:1788592942.501290:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+11:15590:x1875475209252992:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:3.0:1788592942.501311:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592942.501332:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db64c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c329f expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501395:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501410:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501420:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501430:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501471:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501479:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501908:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030000/0xbd314a3362db64d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501931:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030000/0xbd314a3362db64d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.501939:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030000/0xbd314a3362db64d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592942.501972:0:17179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788592942.501976:0:17179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592942.502014:0:17179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921840030000/0xbd314a3362db64d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502027:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502034:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502041:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502048:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592942.502052:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502152:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502228:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:3.0:1788592942.502233:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592942.502238:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502245:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db64ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502262:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502268:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502275:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502280:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592942.502283:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502289:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502297:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff921743721d00) 00010000:00010000:3.0:1788592942.502299:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592942.502302:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502319:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db64d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502349:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db64c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c329f expref: 13 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502377:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030000/0xbd314a3362db64d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c329f expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.502386:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:3.0:1788592942.502388:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788592942.502391:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030000, rc 0) 00000100:00100000:3.0:1788592942.502722:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+12:15590:x1875475209252992:12345-192.168.203.47@tcp:101:bash.0 Request processed in 1432us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592942.502730:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 36 00000100:00100000:1.0:1788592942.506011:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.506284:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209253120 00000100:00100000:3.0:1788592942.506294:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209253120 00000100:00100000:3.0:1788592942.506396:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:3.0:1788592942.506407:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1b09db4-0481-49f3-89da-591dd9a69226+5:15590:x1875475209253120:12345-192.168.203.47@tcp:900:bash.0 00000100:00100000:3.0:1788592942.506683:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1b09db4-0481-49f3-89da-591dd9a69226+5:15590:x1875475209253120:12345-192.168.203.47@tcp:900:bash.0 Request processed in 277us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592942.506691:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:1.0:1788592942.509832:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.509935:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209253376 00000100:00100000:0.0:1788592942.509945:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209253376 00000100:00100000:0.0:1788592942.510034:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:0.0:1788592942.510045:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+12:15590:x1875475209253376:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592942.510091:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.510112:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db64df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32a6 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.510335:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.510351:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.510359:0:17181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.510392:0:17181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.510419:0:17181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 12 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592942.510434:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17181:1875475226100224:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592942.510524:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184384af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592942.515481:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592942.515574:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209253504 00000100:00100000:2.0:1788592942.515584:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209253504 00010000:00010000:2.0:1788592942.515652:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 13 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592942.515714:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 16 00000100:00100000:2.0:1788592942.515725:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+13:2396:x1875475209253504:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592942.515742:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592942.515749:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 13 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.515762:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 13 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.515785:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:2.0:1788592942.515790:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.515799:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.515807:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592942.515824:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592942.515886:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+13:2396:x1875475209253504:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 162us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592942.515893:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 16 00010000:00010000:0.0:1788592942.518638:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db64bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3298 expref: 12 pid: 17181 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592942.518663:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17181:1875475226100224:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592942.518688:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.518699:0:17181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.518705:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.518737:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.518748:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.518757:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520369:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520401:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520412:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.520426:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788592942.520465:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520473:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520481:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520487:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.520492:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520500:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520512:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:0.0:1788592942.520515:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592942.520519:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520526:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db64e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592942.520547:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5ba5f49 reply state 0000000007d11f52 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520563:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520570:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff921875ae0100) 00010000:00010000:0.0:1788592942.520573:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592942.520575:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788592942.520622:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db64df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 15 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520637:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 14 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.520645:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592942.520647:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788592942.520649:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838000, rc 0) 00000100:00100000:0.0:1788592942.520723:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218698b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+15:15590:x1875475209253376:12345-192.168.203.47@tcp:101:bash.0 Request processed in 10680us (10899us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788592942.520732:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 37 00000100:00100000:1.0:1788592942.541824:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.541929:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209253632 00000100:00100000:0.0:1788592942.541939:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209253632 00000100:00100000:0.0:1788592942.542002:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:0.0:1788592942.542012:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+15:15590:x1875475209253632:12345-192.168.203.47@tcp:101:bash.0 00010000:00010000:0.0:1788592942.542036:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.542057:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6502 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32ad expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542175:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542207:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542219:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.542265:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788592942.542270:0:17180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788592942.542287:0:17180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542298:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542324:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6502 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 17 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542342:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.542351:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592942.542353:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592942.542357:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839200, rc 0) 00000100:00100000:0.0:1788592942.542410:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+16:15590:x1875475209253632:12345-192.168.203.47@tcp:101:bash.0 Request processed in 399us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.542417:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 38 00000100:00100000:3.0:1788592942.548460:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592942.548565:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209253888 00000100:00100000:2.0:1788592942.548575:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209253888 00000100:00100000:2.0:1788592942.548645:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 5 00000100:00100000:2.0:1788592942.548655:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+16:15590:x1875475209253888:12345-192.168.203.47@tcp:35:bash.0 00000100:00100000:2.0:1788592942.548948:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+17:15590:x1875475209253888:12345-192.168.203.47@tcp:35:bash.0 Request processed in 294us (505us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788592942.548956:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 5 00000040:00080000:2.0:1788592942.652495:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788592942.655305:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.662765:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209254144 00000100:00100000:3.0:1788592942.662784:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209254144 00000100:00100000:3.0:1788592942.662860:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:3.0:1788592942.662889:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+17:15601:x1875475209254144:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:3.0:1788592942.662916:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592942.662937:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32b4 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592942.663031:0:18707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788592942.663982:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6510 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32b4 expref: 19 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.663999:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff921875ae0800) 00010000:00010000:3.0:1788592942.664003:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592942.664009:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32b4 expref: 19 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592942.664024:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030600, rc 0) 00000100:00100000:3.0:1788592942.664789:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+18:15601:x1875475209254144:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 1899us (9489us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788592942.664799:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 39 00000100:00100000:1.0:1788592942.673557:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592942.673726:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209254400 00000100:00100000:2.0:1788592942.673735:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209254400 00000100:00100000:2.0:1788592942.673792:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:2.0:1788592942.673802:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+18:15601:x1875475209254400:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:2.0:1788592942.674581:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+19:15601:x1875475209254400:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 779us (1030us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788592942.674590:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 6 00000100:00100000:2.0:1788592942.736759:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.736988:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209254656 00000100:00100000:0.0:1788592942.736998:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209254656 00000100:00100000:0.0:1788592942.737124:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:0.0:1788592942.737153:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+19:15604:x1875475209254656:12345-192.168.203.47@tcp:101:lfs.0 00010000:00010000:0.0:1788592942.737191:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592942.737219:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db651e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32bb expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.737323:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db6525 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.737339:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db6525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.737352:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db6525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592942.737363:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788592942.737462:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db651e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32bb expref: 22 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.737482:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db6525 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32bb expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.737491:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592942.737494:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592942.737497:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839c00, rc 0) 00000100:00100000:0.0:1788592942.737558:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+21:15604:x1875475209254656:12345-192.168.203.47@tcp:101:lfs.0 Request processed in 407us (808us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788592942.737565:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 40 00000100:00100000:1.0:1788592942.742435:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.742520:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209254784 00000100:00100000:0.0:1788592942.742530:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209254784 00000100:00100000:0.0:1788592942.742618:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:0.0:1788592942.742628:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+21:15604:x1875475209254784:12345-192.168.203.47@tcp:54:lfs.0 00010000:00010000:0.0:1788592942.742694:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742711:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742723:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742758:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742765:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742772:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742778:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592942.742782:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742790:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742800:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592942.742804:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592942.742808:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.742825:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db6533 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592942.742897:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+21:15604:x1875475209254784:12345-192.168.203.47@tcp:54:lfs.0 Request processed in 270us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.742904:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 41 00000100:00100000:1.0:1788592942.745915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592942.745998:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209254912 00000100:00100000:0.0:1788592942.746007:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209254912 00000100:00100000:0.0:1788592942.746105:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:0.0:1788592942.746115:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+21:2395:x1875475209254912:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592942.746130:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592942.746153:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839c00/0xbd314a3362db6525 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32bb expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592942.746188:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592942.746200:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592942.746245:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+20:2395:x1875475209254912:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 132us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592942.746252:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:2.0:1788592942.750364:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592942.750528:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209255168 00000100:00100000:3.0:1788592942.750538:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209255168 00000100:00100000:3.0:1788592942.750593:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:3.0:1788592942.750614:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+20:15604:x1875475209255168:12345-192.168.203.47@tcp:35:lfs.0 00000100:00100000:3.0:1788592942.750837:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+21:15604:x1875475209255168:12345-192.168.203.47@tcp:35:lfs.0 Request processed in 226us (481us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788592942.750844:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 7 00000100:00100000:1.0:1788592943.129118:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.129294:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209255424 00000100:00100000:3.0:1788592943.129312:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209255424 00000100:00100000:3.0:1788592943.129390:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00100000:3.0:1788592943.129402:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+21:15635:x1875475209255424:12345-192.168.203.47@tcp:101:cat.0 00010000:00010000:3.0:1788592943.129434:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.129456:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db653a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32c2 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.129551:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6541 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.129566:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.129580:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592943.129601:0:17179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788592943.129727:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db653a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32c2 expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.129749:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6541 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32c2 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.129758:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:3.0:1788592943.129761:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592943.129765:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840031600, rc 0) 00000100:00100000:3.0:1788592943.129831:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+23:15635:x1875475209255424:12345-192.168.203.47@tcp:101:cat.0 Request processed in 432us (774us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788592943.129838:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 42 00000100:00080000:1.0:1788592943.130305:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592943.136504:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.136551:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.136797:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209255808 00000100:00100000:0.0:1788592943.136807:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209255808 00000100:00100000:0.0:1788592943.136876:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:0.0:1788592943.136887:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1b09db4-0481-49f3-89da-591dd9a69226+23:2396:x1875475209255808:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592943.136904:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592943.136930:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6541 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32c2 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.136962:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592943.136968:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592943.137028:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1b09db4-0481-49f3-89da-591dd9a69226+22:2396:x1875475209255808:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 142us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.137036:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:3.0:1788592943.138062:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209255680 00000100:00100000:3.0:1788592943.138324:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209255680 00000100:00100000:3.0:1788592943.138484:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:3.0:1788592943.138497:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+22:15635:x1875475209255680:12345-192.168.203.47@tcp:35:cat.0 00000100:00100000:3.0:1788592943.138821:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+23:15635:x1875475209255680:12345-192.168.203.47@tcp:35:cat.0 Request processed in 326us (2324us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788592943.138829:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 8 00000100:00100000:1.0:1788592943.227475:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.227690:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209256064 00000100:00100000:0.0:1788592943.227700:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209256064 00000100:00100000:0.0:1788592943.227766:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:0.0:1788592943.227776:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+23:15641:x1875475209256064:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:0.0:1788592943.227800:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592943.227821:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db654f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32c9 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.227941:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.227957:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.227964:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.227973:0:17181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.228003:0:17181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.228041:0:17181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 24 pid: 17180 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592943.228190:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17181:1875475226100352:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592943.228419:0:17181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.228430:0:17181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592943.228439:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17181:1875475226100480:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592943.228466:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff92185880a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.231942:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.232098:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17181:1875475226100352:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592943.232115:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17181:1875475226100480:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592943.232144:0:17181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592943.232312:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209256192 00000100:00100000:2.0:1788592943.232319:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209256192 00010000:00010000:2.0:1788592943.232356:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 25 pid: 17180 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592943.232395:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:2.0:1788592943.232404:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1b09db4-0481-49f3-89da-591dd9a69226+25:2396:x1875475209256192:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592943.232419:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592943.232426:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 25 pid: 17180 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.232438:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 25 pid: 17180 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.232488:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839200/0xbd314a3362db6509 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ad expref: 25 pid: 17180 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.232503:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:2.0:1788592943.232508:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.232516:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.232533:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592943.232584:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1b09db4-0481-49f3-89da-591dd9a69226+24:2396:x1875475209256192:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 180us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592943.232601:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 17 00000100:00100000:2.0:1788592943.235900:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.236044:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209256320 00000100:00100000:1.0:1788592943.236053:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209256320 00010000:00010000:1.0:1788592943.236125:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.236188:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:1.0:1788592943.236198:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921848c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+24:2396:x1875475209256320:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592943.236212:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592943.236218:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.236230:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.236251:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838000/0xbd314a3362db64f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32a6 expref: 24 pid: 17181 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.236267:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:1.0:1788592943.236272:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.236280:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.236287:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.236324:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592943.236484:0:17181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.236492:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592943.236511:0:17181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788592943.236673:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838200/0xbd314a3362db654f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32c9 expref: 25 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.236688:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838600/0xbd314a3362db6556 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32c9 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.236708:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592943.236711:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592943.236713:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742838600, rc 0) 00000100:00100000:1.0:1788592943.236758:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921848c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+24:2396:x1875475209256320:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 560us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592943.236766:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 18 00000100:00100000:0.0:1788592943.237819:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+23:15641:x1875475209256064:12345-192.168.203.47@tcp:101:dd.0 Request processed in 10040us (10350us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788592943.237889:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 43 00000100:00100000:3.0:1788592943.241873:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592943.242643:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209256448 00000100:00100000:2.0:1788592943.242653:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209256448 00000100:00100000:2.0:1788592943.242752:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:2.0:1788592943.242763:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+23:15641:x1875475209256448:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:2.0:1788592943.242795:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592943.242819:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6564 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32d0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.242854:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.242867:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.242895:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.243009:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6564 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 25 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.243026:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.243034:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:2.0:1788592943.243037:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592943.243041:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81c00, rc 0) 00000100:00100000:2.0:1788592943.243321:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+24:15641:x1875475209256448:12345-192.168.203.47@tcp:101:dd.0 Request processed in 559us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592943.243328:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 44 00000100:00100000:3.0:1788592943.245773:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.246705:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209256704 00000100:00100000:0.0:1788592943.246715:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209256704 00000100:00100000:0.0:1788592943.246772:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 45 00000100:00100000:0.0:1788592943.246782:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+24:15641:x1875475209256704:12345-192.168.203.47@tcp:36:dd.0 00010000:00010000:0.0:1788592943.246982:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.246997:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.247007:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592943.247047:0:17180:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788592943.247208:0:17180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fb020e1 reply state 000000003ad2dc55 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.247220:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.247227:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592943.247230:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592943.247250:0:17180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592943.247327:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+27:15641:x1875475209256704:12345-192.168.203.47@tcp:36:dd.0 Request processed in 546us (1560us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788592943.247334:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 45 00000020:00080000:0.0:1788592943.247338:0:17180:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788592943.249476:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.249671:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209256832 00000100:00100000:3.0:1788592943.249680:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209256832 00000100:00100000:3.0:1788592943.249729:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:3.0:1788592943.249739:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+27:15641:x1875475209256832:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:3.0:1788592943.249758:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.249775:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6579 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32d7 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.249825:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6579 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d7 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.249838:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6579 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d7 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.249855:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:3.0:1788592943.249858:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592943.249861:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030600, rc 0) 00000100:00100000:3.0:1788592943.251879:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+28:15641:x1875475209256832:12345-192.168.203.47@tcp:101:dd.0 Request processed in 2134us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.251904:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 46 00000100:00100000:3.0:1788592943.273936:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.274054:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257088 00000100:00100000:0.0:1788592943.274063:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257088 00000100:00100000:0.0:1788592943.274177:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:0.0:1788592943.274187:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1b09db4-0481-49f3-89da-591dd9a69226+28:15641:x1875475209257088:12345-192.168.203.47@tcp:103:dd.0 00010000:00010000:0.0:1788592943.274202:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592943.274225:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6579 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d7 expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.274245:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592943.274249:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592943.274295:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1b09db4-0481-49f3-89da-591dd9a69226+27:15641:x1875475209257088:12345-192.168.203.47@tcp:103:dd.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.274301:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 2 00000100:00100000:0.0:1788592943.277228:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592943.277750:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257216 00000100:00100000:2.0:1788592943.277761:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257216 00000100:00100000:2.0:1788592943.277819:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 47 00000100:00100000:2.0:1788592943.277829:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+27:15641:x1875475209257216:12345-192.168.203.47@tcp:58:dd.0 00010000:00010000:2.0:1788592943.278047:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.278273:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.278288:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592943.284422:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592943.284779:0:17179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788592943.285333:0:17179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788592943.285846:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+27:15641:x1875475209257216:12345-192.168.203.47@tcp:58:dd.0 Request processed in 8012us (8620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592943.285858:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 47 00010000:00010000:2.0:1788592943.288993:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592943.290320:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.290427:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257344 00000100:00100000:3.0:1788592943.290437:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257344 00000100:00100000:3.0:1788592943.290495:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:3.0:1788592943.290506:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+27:15641:x1875475209257344:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:3.0:1788592943.290634:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.290656:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32de expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.290749:0:17181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.290761:0:17181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.290780:0:17181:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.290792:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.290804:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:3.0:1788592943.290808:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592943.290811:0:17181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 28 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.290819:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030c00, rc 0) 00000100:00100000:3.0:1788592943.290939:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+28:15641:x1875475209257344:12345-192.168.203.47@tcp:101:dd.0 Request processed in 434us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.290946:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 48 00000100:00100000:2.0:1788592943.416712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ed83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226100608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788592943.416809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592943.417044:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226100608 00000100:00100000:0.0:1788592943.417053:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226100608 00000100:00100000:0.0:1788592943.417173:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592943.417184:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226100608:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788592943.417462:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788592943.417664:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788592943.417771:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875475226100608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 589us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.417779:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788592943.418740:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ed83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1875475226100608:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788592943.672684:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788592943.672695:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592943.673016:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788592943.673288:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788592943.673431:0:17215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17215:1875475226100736:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592943.673529:0:17215:0:(client.c:2716:ptlrpc_set_wait()) set ffff92186ba21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592943.677502:0:17215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92186b9f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17215:1875475226100736:192.168.203.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788592943.679233:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.679334:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257472 00000100:00100000:3.0:1788592943.679344:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257472 00000100:00100000:3.0:1788592943.679403:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:3.0:1788592943.679414:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+28:15642:x1875475209257472:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592943.679445:0:17180:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592943.679577:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+28:15642:x1875475209257472:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 164us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.679585:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 49 00000100:00100000:1.0:1788592943.682965:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.683061:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257600 00000100:00100000:3.0:1788592943.683101:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257600 00000100:00100000:3.0:1788592943.683225:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:3.0:1788592943.683235:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+28:15642:x1875475209257600:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788592943.683306:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683324:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683336:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683398:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683407:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683436:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683461:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683470:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683477:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592943.683523:0:18707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788592943.683528:0:18707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788592943.683543:0:18707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683672:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683681:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683688:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683694:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031400 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592943.683698:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683705:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683725:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921875ae0000) 00010000:00010000:3.0:1788592943.683728:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592943.683733:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683739:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db658e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683755:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683761:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683766:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683772:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592943.683775:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683781:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683788:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff921743721200) 00010000:00010000:3.0:1788592943.683791:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592943.683794:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683799:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db6595 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683827:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683834:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683840:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683845:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592943.683848:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683861:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683869:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:3.0:1788592943.683871:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592943.683874:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.683880:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db659c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592943.683962:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+28:15642:x1875475209257600:12345-192.168.203.47@tcp:34:lhsmtool_posix.0 Request processed in 726us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.683970:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 50 00000100:00100000:1.0:1788592943.687335:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.687416:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257856 00000100:00100000:3.0:1788592943.687426:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257856 00000100:00100000:3.0:1788592943.687536:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:3.0:1788592943.687571:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+28:15642:x1875475209257856:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592943.687597:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.687621:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32e5 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687728:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687744:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687755:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592943.687765:0:17180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788592943.687841:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687849:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687856:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687861:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841494800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592943.687865:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687873:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687885:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:3.0:1788592943.687894:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592943.687899:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687906:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687947:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65a3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32e5 expref: 30 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687958:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff921875ae0000) 00010000:00010000:3.0:1788592943.687960:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592943.687964:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32e5 expref: 30 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.687975:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840031600, rc 0) 00000100:00100000:3.0:1788592943.688101:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+29:15642:x1875475209257856:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 531us (774us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788592943.688109:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 51 00000100:00100000:1.0:1788592943.690747:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.690873:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209257984 00000100:00100000:0.0:1788592943.690882:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209257984 00000100:00100000:0.0:1788592943.690934:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:0.0:1788592943.690944:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+29:15642:x1875475209257984:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788592943.690975:0:17181:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788592943.691192:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+29:15642:x1875475209257984:12345-192.168.203.47@tcp:53:lhsmtool_posix.0 Request processed in 249us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.691199:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 52 00000100:00100000:1.0:1788592943.694238:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592943.694395:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209258240 00000100:00100000:2.0:1788592943.694405:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209258240 00000100:00100000:2.0:1788592943.694468:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:2.0:1788592943.694479:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+29:15642:x1875475209258240:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592943.694498:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592943.694518:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db65b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32ec expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592943.695245:0:17179:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1788592943.695251:0:17179:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788592943.695270:0:17179:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788592943.695414:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81200/0xbd314a3362db65bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.695428:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81200/0xbd314a3362db65bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.695438:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81200/0xbd314a3362db65bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.695489:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80a00/0xbd314a3362db65b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ec expref: 32 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.695505:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81200/0xbd314a3362db65bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ec expref: 31 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.695513:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743726300) 00010000:00010000:2.0:1788592943.695516:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592943.695529:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81200, rc 0) 00000100:00100000:2.0:1788592943.695601:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+31:15642:x1875475209258240:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1371us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788592943.695610:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 53 00000100:00100000:1.0:1788592943.700267:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.700510:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209258496 00000100:00100000:3.0:1788592943.700521:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209258496 00000100:00100000:3.0:1788592943.700585:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:3.0:1788592943.700605:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+31:15642:x1875475209258496:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788592943.700662:0:18707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592943.700686:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81200/0xbd314a3362db65bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32ec expref: 31 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.700705:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743726300) 00010000:00010000:3.0:1788592943.700749:0:18707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592943.700774:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.700788:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.700798:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.700839:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.700847:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.700854:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701033:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701041:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701048:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701093:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841494800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592943.701098:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701105:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701122:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:3.0:1788592943.701124:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592943.701129:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701135:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841494800/0xbd314a3362db65cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701145:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701152:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701302:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701311:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:3.0:1788592943.701314:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701321:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701329:0:18707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7dbbc879 (ffff921743721200) 00010000:00010000:3.0:1788592943.701331:0:18707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592943.701339:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.701345:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db65d4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7dbbc879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592943.701660:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+30:15642:x1875475209258496:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 1054us (1399us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592943.701668:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 54 00000100:00100000:1.0:1788592943.704578:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.704941:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209258624 00000100:00100000:3.0:1788592943.704951:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209258624 00000100:00100000:3.0:1788592943.705014:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:3.0:1788592943.705135:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+30:15642:x1875475209258624:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592943.705156:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.705180:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32f3 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.705219:0:17180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db65e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.705233:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db65e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.705244:0:17180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db65e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.705361:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32f3 expref: 32 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.705381:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030e00/0xbd314a3362db65e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32f3 expref: 31 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.705390:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:3.0:1788592943.705399:0:17180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788592943.705404:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030e00, rc 0) 00000100:00100000:3.0:1788592943.705984:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+31:15642:x1875475209258624:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 959us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.705993:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 55 00000100:00100000:1.0:1788592943.710762:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.710944:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209258880 00000100:00100000:0.0:1788592943.710954:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209258880 00000100:00100000:0.0:1788592943.711053:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:0.0:1788592943.711130:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+31:15642:x1875475209258880:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592943.711298:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.711316:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.711328:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592943.711598:0:17181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788592943.711610:0:17181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 477958541989ns, next at 478958539279ns, rc = 0 00000004:00010000:0.0:1788592943.711661:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003159137c reply state 00000000016e7f51 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.711674:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.711704:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:0.0:1788592943.711707:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788592943.711711:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592943.711860:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+33:15642:x1875475209258880:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 796us (1106us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788592943.711878:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 56 00000100:00100000:2.0:1788592943.714774:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.715758:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209259008 00000100:00100000:3.0:1788592943.715769:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209259008 00000100:00100000:3.0:1788592943.715858:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:3.0:1788592943.715868:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+33:15642:x1875475209259008:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592943.715908:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.715930:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c32fa expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.715995:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 34 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.716017:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 34 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.716053:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:3.0:1788592943.716056:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592943.716059:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030600, rc 0) 00000100:00100000:3.0:1788592943.716161:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186b9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+34:15642:x1875475209259008:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 293us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.716177:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 57 00000100:00100000:1.0:1788592943.723309:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.723346:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209259136 00000100:00100000:3.0:1788592943.723356:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209259136 00000100:00100000:2.0:1788592943.724398:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:2.0:1788592943.724410:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209259136:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788592943.724699:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+6:2395:x1875475209259136:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 283us (1390us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788592943.724708:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00080000:1.0:1788592943.725667:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592943.736979:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592943.737118:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209259392 00000100:00100000:2.0:1788592943.737139:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209259392 00000100:00100000:2.0:1788592943.737201:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:2.0:1788592943.737212:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+34:15642:x1875475209259392:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788592943.737441:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1b09db4-0481-49f3-89da-591dd9a69226+35:15642:x1875475209259392:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 230us (470us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788592943.737449:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 9 00000100:00100000:3.0:1788592943.759611:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.761429:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209259648 00000100:00100000:1.0:1788592943.761444:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209259648 00000100:00100000:1.0:1788592943.761540:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:1.0:1788592943.761555:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+35:15642:x1875475209259648:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788592943.762647:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+35:15642:x1875475209259648:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 1093us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592943.762658:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 58 00000100:00100000:1.0:1788592943.769856:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.774989:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209259776 00000100:00100000:3.0:1788592943.775005:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209259776 00000100:00100000:3.0:1788592943.775141:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:3.0:1788592943.775152:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+35:15642:x1875475209259776:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592943.775626:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592943.775652:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80c00/0xbd314a3362db65f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3301 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.775720:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db65fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.775735:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db65fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.775749:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db65fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592943.775794:0:17179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788592943.775814:0:17179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db65fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.775841:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b80c00/0xbd314a3362db65f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3301 expref: 37 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.775876:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db65fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3301 expref: 36 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.775885:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:2.0:1788592943.775888:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788592943.775891:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921875b81800, rc 0) 00000100:00100000:2.0:1788592943.775962:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+36:15642:x1875475209259776:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 812us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592943.775970:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 59 00000100:00100000:1.0:1788592943.789765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.796907:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209259904 00000100:00100000:0.0:1788592943.796921:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209259904 00000100:00100000:0.0:1788592943.796999:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:0.0:1788592943.797010:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1b09db4-0481-49f3-89da-591dd9a69226+6:2396:x1875475209259904:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592943.797028:0:18684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592943.797061:0:18684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3308 expref: -99 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592943.797126:0:18684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc32f, blocks: 0x0 00010000:00010000:0.0:1788592943.797146:0:18684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1788592943.797150:0:18684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592943.797330:0:18684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 7 pid: 18684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.797352:0:18684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 7 pid: 18684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.797366:0:18684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839800, rc 0) 00000100:00100000:0.0:1788592943.797434:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1b09db4-0481-49f3-89da-591dd9a69226+7:2396:x1875475209259904:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 425us (7740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.797459:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:3.0:1788592943.810388:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.810967:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209260160 00000100:00100000:0.0:1788592943.810977:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209260160 00000100:00100000:0.0:1788592943.811044:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:0.0:1788592943.811063:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+36:15642:x1875475209260160:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788592943.811208:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+36:15642:x1875475209260160:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 154us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.811215:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 60 00000100:00100000:1.0:1788592943.816296:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.817653:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209260288 00000100:00100000:0.0:1788592943.817665:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209260288 00000100:00100000:0.0:1788592943.817743:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 61 00000100:00100000:0.0:1788592943.817753:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+36:15642:x1875475209260288:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788592943.821480:0:17160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788592943.821506:0:17160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788592943.821571:0:17160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788592943.821661:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.821675:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.821683:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.821689:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:2.0:1788592943.821705:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.821719:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.821736:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:2.0:1788592943.821739:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788592943.821746:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.821766:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031a00/0xbd314a3362db6492 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592943.821887:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592943.821905:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ed83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226100864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788592943.821968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592943.822083:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226100864 00000100:00100000:1.0:1788592943.822091:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226100864 00000100:00100000:1.0:1788592943.822137:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788592943.822147:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226100864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788592943.822287:0:18682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788592943.822291:0:18682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788592943.822299:0:18682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788592943.822301:0:18682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788592943 -> 1788592943 00002000:00010000:1.0:1788592943.822303:0:18682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788592943.822347:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875475226100864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (378us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788592943.822355:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1788592943.822395:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92187ed83b80/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788592943.822401:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ed83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226100864:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788592943.822965:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.822975:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.822983:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.822989:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921841495e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592943.822993:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823000:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823022:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff921743721d00) 00010000:00010000:0.0:1788592943.823026:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592943.823030:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823037:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921841495e00/0xbd314a3362db643e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823452:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823460:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823466:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823472:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840030a00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592943.823475:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823481:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823501:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff921743721400) 00010000:00010000:0.0:1788592943.823504:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592943.823507:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823512:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030a00/0xbd314a3362db6445 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823536:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823543:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.823659:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1b09db4-0481-49f3-89da-591dd9a69226+18:15642:x1875475209260288:12345-192.168.203.47@tcp:44:lhsmtool_posix.0 Request processed in 5905us (7370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592943.823667:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 61 00010000:00010000:0.0:1788592943.823717:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823722:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592943.823726:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823732:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823741:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff921875ae0100) 00010000:00010000:0.0:1788592943.823743:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592943.823746:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823752:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838e00/0xbd314a3362db64ed lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823768:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823774:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823779:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823790:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839600 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592943.823793:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823799:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823808:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592943.823811:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592943.823814:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823819:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839600/0xbd314a3362db6572 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823831:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823837:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823842:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823847:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742838c00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:0.0:1788592943.823849:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823854:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823871:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:0.0:1788592943.823873:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592943.823877:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.823883:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db65e9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.829928:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.829998:0:19795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209260416 00000100:00100000:0.0:1788592943.830006:0:19795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209260416 00000100:00100000:0.0:1788592943.830101:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1788592943.830111:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ed83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1b09db4-0481-49f3-89da-591dd9a69226+7:2395:x1875475209260416:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788592943.830222:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ed83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1b09db4-0481-49f3-89da-591dd9a69226+7:2395:x1875475209260416:12345-192.168.203.47@tcp:16:lhsmtool_posix.0 Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.830230:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:3.0:1788592943.836854:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.836954:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209260672 00000100:00100000:0.0:1788592943.836965:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209260672 00000100:00100000:0.0:1788592943.837024:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:0.0:1788592943.837034:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+15:15642:x1875475209260672:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592943.837131:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592943.837159:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81800/0xbd314a3362db65fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3301 expref: 15 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.837189:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:0.0:1788592943.837194:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592943.837224:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db660c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.837254:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db660c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.837264:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db660c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592943.837385:0:17181:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c209dde reply state 00000000f32318a0 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db660c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.837397:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742838c00/0xbd314a3362db660c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.837403:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:0.0:1788592943.837406:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788592943.837408:0:17181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592943.837492:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+16:15642:x1875475209260672:12345-192.168.203.47@tcp:36:lhsmtool_posix.0 Request processed in 460us (645us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788592943.837500:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 62 00000100:00100000:2.0:1788592943.843197:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.843445:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209260800 00000100:00100000:0.0:1788592943.843454:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209260800 00000100:00100000:0.0:1788592943.843511:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:0.0:1788592943.843521:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1b09db4-0481-49f3-89da-591dd9a69226+7:15642:x1875475209260800:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592943.843540:0:18684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592943.843566:0:18684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c330f expref: -99 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.843630:0:18684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.843650:0:18684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592943.843654:0:18684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592943.843661:0:18684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 8 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.843693:0:18684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.843706:0:18684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592943.843719:0:18684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18684:1875475226100992:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592943.843792:0:18684:0:(client.c:2716:ptlrpc_set_wait()) set ffff92174244f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.852866:0:18684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18684:1875475226100992:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592943.852929:0:18684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 8 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.852951:0:18684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921742839600, rc 0) 00000100:00100000:0.0:1788592943.853015:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1b09db4-0481-49f3-89da-591dd9a69226+8:15642:x1875475209260800:12345-192.168.203.47@tcp:101:lhsmtool_posix.0 Request processed in 9494us (9827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.853025:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 30 00000100:00100000:2.0:1788592943.853386:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.853881:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209260928 00000100:00100000:1.0:1788592943.853889:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209260928 00010000:00010000:1.0:1788592943.853923:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.853965:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:1.0:1788592943.853974:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744464a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+8:2396:x1875475209260928:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592943.853986:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592943.854006:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.854018:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.854101:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4feaff/0xbd314a3362db6605 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3308 expref: 8 pid: 18684 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.854118:0:17167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592943.854122:0:17167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592943.854129:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 7 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.854139:0:17167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 7 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.854183:0:17167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 7 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.854198:0:17167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17167:1875475226101120:192.168.203.47@tcp:105: 00000100:00100000:1.0:1788592943.854261:0:17167:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592943.871801:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.871919:0:17167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17167:1875475226101120:192.168.203.47@tcp:105: 00010000:00010000:1.0:1788592943.871942:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592943.871998:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744464a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+7:2396:x1875475209260928:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 18024us (18620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592943.872008:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 19 00000100:00100000:3.0:1788592943.872143:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261056 00000100:00100000:3.0:1788592943.872150:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261056 00000100:00100000:3.0:1788592943.872210:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:3.0:1788592943.872220:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+7:2395:x1875475209261056:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788592943.872392:0:18763:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788592943.872396:0:18763:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788592943 00002000:00010000:3.0:1788592943.872399:0:18763:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788592942 00002000:00010000:3.0:1788592943.872402:0:18763:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788592943 -> 1788592943 00002000:00010000:3.0:1788592943.872404:0:18763:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788592943.872429:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+8:2395:x1875475209261056:12345-192.168.203.47@tcp:2:lhsmtool_posix.0 Request processed in 210us (637us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788592943.872436:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 31 00000100:00100000:3.0:1788592943.880148:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.880360:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261184 00000100:00100000:1.0:1788592943.880369:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261184 00000100:00100000:1.0:1788592943.880429:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:1.0:1788592943.880453:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+8:2393:x1875475209261184:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788592943.880497:0:18685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.880516:0:18685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 8 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.880525:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592943.880529:0:18685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592943.880534:0:18685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.880567:0:18685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 8 pid: 18684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.880580:0:18685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 8 pid: 18684 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.880606:0:18685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92187ee21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18685:1875475226101248:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592943.880686:0:18685:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592943.883551:0:18685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92187ee21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18685:1875475226101248:192.168.203.47@tcp:104: 00010000:00010000:1.0:1788592943.883578:0:18685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592943.886514:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592943.887732:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261312 00000100:00100000:2.0:1788592943.887744:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261312 00010000:00010000:2.0:1788592943.887789:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 9 pid: 18684 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592943.887877:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:2.0:1788592943.887887:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1b09db4-0481-49f3-89da-591dd9a69226+9:2396:x1875475209261312:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592943.887908:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592943.887941:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 9 pid: 18684 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.887956:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 9 pid: 18684 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.887978:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2ff8c2d/0xbd314a3362db6613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c330f expref: 9 pid: 18684 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.887995:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592943.887999:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592943.888016:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.888025:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.888104:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592943.888414:0:18685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888431:0:18685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888458:0:18685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888466:0:18685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888474:0:18685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888481:0:18685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b800 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:1.0:1788592943.888485:0:18685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888494:0:18685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888507:0:18685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.888513:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538c2f28/0xbd314a3362db661a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592943.888622:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1b09db4-0481-49f3-89da-591dd9a69226+8:2396:x1875475209261312:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 734us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592943.888630:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 20 00000100:00100000:1.0:1788592943.889719:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1b09db4-0481-49f3-89da-591dd9a69226+7:2393:x1875475209261184:12345-192.168.203.47@tcp:1:lhsmtool_posix.0 Request processed in 9264us (9578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592943.889730:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 32 00000100:00100000:2.0:1788592943.892632:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.892721:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261568 00000100:00100000:0.0:1788592943.892729:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261568 00000100:00100000:0.0:1788592943.892821:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 63 00000100:00100000:0.0:1788592943.892831:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+16:15642:x1875475209261568:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788592943.892905:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.892922:0:17179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 16 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.892931:0:17179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.892964:0:17179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 16 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.892977:0:17179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 16 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592943.892991:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17179:1875475226101376:192.168.203.47@tcp:104: 00000100:00100000:0.0:1788592943.893402:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff92174244f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.898858:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921743b40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17179:1875475226101376:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592943.898892:0:17179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.906909:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592943.907680:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261696 00000100:00100000:0.0:1788592943.907690:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261696 00010000:00010000:0.0:1788592943.907731:0:17167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592943.907793:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 21 00000100:00100000:0.0:1788592943.907803:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187ee21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+17:2396:x1875475209261696:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592943.907816:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592943.907823:0:17167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907835:0:17167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907856:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81c00/0xbd314a3362db656b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32d0 expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907871:0:17167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:0.0:1788592943.907876:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 16 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907886:0:17167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907894:0:17167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907902:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.907942:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592943.907992:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187ee21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1b09db4-0481-49f3-89da-591dd9a69226+16:2396:x1875475209261696:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 191us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.908008:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 21 00010000:00010000:1.0:1788592943.908554:0:17179:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.908564:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.908774:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.908787:0:17179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 16 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.908796:0:17179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.908824:0:17179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 16 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.908838:0:17179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 16 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.908851:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17179:1875475226101504:192.168.203.47@tcp:104: 00000100:00100000:1.0:1788592943.912516:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.916661:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17179:1875475226101504:192.168.203.47@tcp:104: 00010000:00010000:0.0:1788592943.916690:0:17179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592943.917464:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:2.0:1788592943.917685:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261824 00000100:00100000:2.0:1788592943.917692:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261824 00010000:00010000:2.0:1788592943.917729:0:17165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592943.917767:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 22 00000100:00100000:2.0:1788592943.917776:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1b09db4-0481-49f3-89da-591dd9a69226+17:2395:x1875475209261824:12345-192.168.203.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592943.917790:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592943.917797:0:17165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.917809:0:17165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.917830:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db65f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32fa expref: 17 pid: 17179 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.917869:0:17165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:2.0:1788592943.917874:0:17165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.917884:0:17165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.917891:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592943.917920:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592943.917966:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1b09db4-0481-49f3-89da-591dd9a69226+16:2395:x1875475209261824:12345-192.168.203.47@tcp:103:ldlm_bl.0 Request processed in 190us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592943.917973:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 22 00010000:00010000:1.0:1788592943.919234:0:17179:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.919247:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788592943.919360:0:17179:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788592943.919479:0:17179:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788592943.919514:0:17179:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788592943.919604:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17179:1875475226101632:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788592943.919664:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592943.919697:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff921742700600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.919766:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226101632 00000100:00100000:0.0:1788592943.919772:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226101632 00000100:00100000:0.0:1788592943.919812:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788592943.919820:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875475226101632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788592943.919906:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875475226101632:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592943.919914:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788592943.921557:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17179:1875475226101632:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788592943.921742:0:17179:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788592943.921803:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17179:1875475226101760:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788592943.921874:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592943.921909:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.921978:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226101760 00000100:00100000:0.0:1788592943.921984:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226101760 00000100:00100000:0.0:1788592943.922030:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592943.922038:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218756c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1875475226101760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788592943.922210:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218756c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17179:x1875475226101760:12345-0@lo:1000:mdt00_000.0 Request processed in 171us (335us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788592943.922218:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788592943.923358:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218698b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17179:1875475226101760:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788592943.923415:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923432:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923439:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923445:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022b800 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592943.923449:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923483:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923505:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:1.0:1788592943.923508:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592943.923514:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923520:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022b800/0xbd314a3362db6628 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923561:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923574:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923579:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923584:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921875b81e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592943.923595:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923602:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923611:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:1.0:1788592943.923613:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592943.923620:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923643:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923652:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.923713:0:17179:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff921840030c00/0xbd314a3362db6587 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c32de expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.923725:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17179:1875475226101888:192.168.203.47@tcp:105: 00000100:00100000:1.0:1788592943.923800:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff92184832b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592943.933371:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592943.933539:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17179:1875475226101888:192.168.203.47@tcp:105: 00010000:00010000:1.0:1788592943.933566:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933577:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921875b81e00/0xbd314a3362db6580 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933622:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933637:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933648:0:17179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933659:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933681:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933687:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933692:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a200 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592943.933696:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933703:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933714:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:1.0:1788592943.933717:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592943.933720:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933725:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92185022a200/0xbd314a3362db662f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933735:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933741:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933747:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933752:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921742839e00 already unused, calling callback (ffffffffc19d04f0) 00010000:00010000:1.0:1788592943.933762:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933768:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933776:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:1.0:1788592943.933778:0:17179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592943.933781:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592943.933786:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921742839e00/0xbd314a3362db6621 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592943.933964:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1b09db4-0481-49f3-89da-591dd9a69226+19:15642:x1875475209261568:12345-192.168.203.47@tcp:57:lhsmtool_posix.0 Request processed in 41131us (41335us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788592943.933975:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 63 00000020:00080000:1.0:1788592943.933980:0:17179:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788592943.934218:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209261952 00000100:00100000:3.0:1788592943.934225:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209261952 00000100:00100000:3.0:1788592943.934266:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 10 00000100:00100000:3.0:1788592943.934275:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92187e6ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+19:15641:x1875475209261952:12345-192.168.203.47@tcp:49:dd.0 00000100:00100000:3.0:1788592943.934355:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92187e6ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+19:15641:x1875475209261952:12345-192.168.203.47@tcp:49:dd.0 Request processed in 82us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.934362:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 10 00000040:00080000:2.0:1788592943.934944:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788592943.934949:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592943.934979:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788592943.934984:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788592943.937515:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.937579:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262208 00000100:00100000:3.0:1788592943.937595:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262208 00000100:00100000:3.0:1788592943.937647:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 11 00000100:00100000:3.0:1788592943.937656:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+19:15642:x1875475209262208:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788592943.937898:0:17183:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788592943.937926:0:17183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788592943.937956:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.937973:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.937984:0:17183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.937993:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.937999:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.938005:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.938055:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788592943.938445:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1b09db4-0481-49f3-89da-591dd9a69226+21:15642:x1875475209262208:12345-192.168.203.47@tcp:35:lhsmtool_posix.0 Request processed in 788us (936us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788592943.938453:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 11 00000020:00080000:3.0:1788592943.938458:0:17183:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788592943.939006:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592943.939014:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.939023:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031600 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:0.0:1788592943.939027:0:17168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.939045:0:17168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.939093:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff921743721f00) 00010000:00010000:0.0:1788592943.939096:0:17168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592943.939101:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.939107:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031600/0xbd314a3362db6636 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592943.939122:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592943.939124:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592943.939135:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592943.943985:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592943.944111:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262336 00000100:00100000:3.0:1788592943.944122:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262336 00000100:00100000:3.0:1788592943.944190:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:3.0:1788592943.944200:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+21:15641:x1875475209262336:12345-192.168.203.47@tcp:101:dd.0 00010000:00010000:3.0:1788592943.944224:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592943.944247:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db663d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc629d962d45c3316 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.944284:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6644 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.944298:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.944309:0:17181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.944431:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff921840031400/0xbd314a3362db663d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3316 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.944450:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff921840030600/0xbd314a3362db6644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.47@tcp remote: 0xc629d962d45c3316 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592943.944472:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff921875ae0a00) 00010000:00010000:3.0:1788592943.944476:0:17181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788592943.944480:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff921840030600, rc 0) 00000100:00100000:3.0:1788592943.944544:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+22:15641:x1875475209262336:12345-192.168.203.47@tcp:101:dd.0 Request processed in 345us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592943.944551:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 64 00000100:00100000:1.0:1788592944.182296:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592944.182940:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262464 00000100:00100000:0.0:1788592944.182951:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262464 00000100:00100000:3.0:1788592944.183642:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:3.0:1788592944.183656:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218756c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1b09db4-0481-49f3-89da-591dd9a69226+7:2395:x1875475209262464:12345-192.168.203.47@tcp:4:dd.0 00002000:00010000:3.0:1788592944.183706:0:18689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9bc32f, atime: 0x6a9bc32e, ctime: 0x6a9bc32f, blocks: 0x0 00010000:00010000:3.0:1788592944.183715:0:18689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592944.183732:0:18689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1788592944.183736:0:18689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592944.183743:0:18689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592944.183758:0:18689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592944.193700:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:1.0:1788592944.193890:0:18690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788592944.193900:0:18690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788592944.195939:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262592 00000100:00100000:0.0:1788592944.195951:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262592 00000100:00100000:1.0:1788592944.202821:0:20318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 1 00000100:00100000:1.0:1788592944.202844:0:20318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a1b09db4-0481-49f3-89da-591dd9a69226+9:2396:x1875475209262592:12345-192.168.203.47@tcp:4:dd.0 00010000:00010000:1.0:1788592944.202885:0:20318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592944.202902:0:20318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592944.202907:0:20318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592944.202913:0:20318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592944.202940:0:20318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592944.314878:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788592944.373092:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788592944.373112:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1788592944.373307:0:18689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788592944.373312:0:18689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788592943 -> 1788592944 00002000:00010000:2.0:1788592944.373314:0:18689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788592943 -> 1788592944 00002000:00010000:2.0:1788592944.373317:0:18689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788592944.373346:0:18689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.373359:0:18689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.373385:0:18689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.373392:0:18689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff921840031400 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592944.373397:0:18689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.373407:0:18689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.373440:0:18689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.373450:0:18689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfe4ebf/0xbd314a3362db664b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592944.373564:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218756c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1b09db4-0481-49f3-89da-591dd9a69226+7:2395:x1875475209262464:12345-192.168.203.47@tcp:4:dd.0 Request processed in 189908us (191273us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788592944.373579:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 0 00000100:00100000:1.0:1788592944.440292:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788592944.440373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592944.440636:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102016 00000100:00100000:0.0:1788592944.440646:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102016 00000100:00100000:0.0:1788592944.440700:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592944.440711:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9218756c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226102016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788592944.440746:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788592944.440804:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9218756c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226102016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592944.440829:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592944.442268:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226102144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788592944.442321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592944.442472:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102144 00000100:00100000:1.0:1788592944.442479:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102144 00000100:00100000:1.0:1788592944.442522:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788592944.442530:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226102144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788592944.442563:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788592944.442612:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226102144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592944.442618:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788592944.443142:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788592944.443746:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226102144:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788592944.465931:0:18679:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788592944.468497:0:20318:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788592944.468573:0:20318:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788592944.468601:0:20318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.468637:0:20318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.468647:0:20318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.468655:0:20318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92185022a200 already unused, calling callback (ffffffffc0dc24f0) 00010000:00010000:2.0:1788592944.468660:0:20318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.468669:0:20318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.468688:0:20318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592944.468696:0:20318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5762cbd/0xbd314a3362db6652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592944.468874:0:20318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2396:x1875475209262592:12345-192.168.203.47@tcp:4:dd.0 Request processed in 266035us (275179us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788592944.468886:0:20318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 1 00000040:00080000:1.0:1788592945.209034:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788592945.337104:0:19796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592945.464286:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592945.464308:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592945.464396:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592945.464717:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102272 00000100:00100000:3.0:1788592945.464725:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102272 00000100:00100000:3.0:1788592945.464781:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788592945.464797:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226102272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592945.464827:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788592945.464875:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226102272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592945.464882:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788592945.464902:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592945.464936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592945.465091:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592945.465102:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226102400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788592945.465135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592945.465389:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102400 00000100:00100000:3.0:1788592945.465394:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102400 00000100:00100000:3.0:1788592945.465434:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592945.465441:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226102400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788592945.465451:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788592945.465483:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875475226102400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592945.465489:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592945.465519:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9217444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1875475226102400:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788592945.465597:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592945.465936:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226102912:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.465969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.465995:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226103424:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466024:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.466056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788592945.466062:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226102528:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.466137:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226103040:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466170:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.466195:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226103552:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.466284:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102912 00000100:00100000:0.0:1788592945.466289:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102912 00000100:00100000:0.0:1788592945.466319:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103424 00000100:00100000:0.0:1788592945.466322:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103424 00000100:00100000:0.0:1788592945.466338:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103552 00000100:00100000:0.0:1788592945.466341:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103552 00000100:00100000:0.0:1788592945.466354:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592945.466360:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226102912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466396:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875475226102912:12345-0@lo:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592945.466409:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592945.466424:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788592945.466430:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226103424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466458:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875475226103424:12345-0@lo:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592945.466463:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788592945.466473:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788592945.466479:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226103552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466512:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875475226103552:12345-0@lo:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592945.466518:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788592945.466537:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102528 00000100:00100000:0.0:1788592945.466541:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102528 00000100:00100000:0.0:1788592945.466564:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788592945.466570:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226102528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466607:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70647b28-81c8-4371-870a-35a99a7dd483+24:3641:x1875475226102528:12345-0@lo:400:kworker.0 Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592945.466613:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788592945.466638:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103040 00000100:00100000:0.0:1788592945.466642:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103040 00000100:00100000:0.0:1788592945.466910:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592945.466919:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921741dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226103040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.466951:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921741dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875475226103040:12345-0@lo:400:kworker.0 Request processed in 35us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592945.466957:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592945.466993:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226102784:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.467021:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.467122:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226103296:0@lo:400:kworker.0 00000100:00080000:1.0:1788592945.467289:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788592945.467294:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592945.467316:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:70647b28-81c8-4371-870a-35a99a7dd483:3641:1875475226102528:0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467328:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1875475226103040:0@lo:400:kworker.0 00010000:00080000:1.0:1788592945.467342:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218756c6a00 x1875475226103552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592945.467353:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1875475226103552:0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467363:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875475226102912:0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467372:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1875475226103424:0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467412:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102784 00000100:00100000:1.0:1788592945.467417:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102784 00000100:00100000:1.0:1788592945.467448:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788592945.467455:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226102784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467498:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875475226102784:12345-0@lo:400:kworker.0 Request processed in 43us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592945.467504:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788592945.467520:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592945.467569:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592945.467608:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226103808:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.467629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592945.467738:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103296 00000100:00100000:1.0:1788592945.467742:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103296 00000100:00100000:1.0:1788592945.467767:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103808 00000100:00100000:1.0:1788592945.467770:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103808 00000100:00100000:1.0:1788592945.467789:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592945.467794:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226103296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467841:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875475226103296:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592945.467847:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592945.467858:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788592945.467864:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226103808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.467886:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875475226103808:12345-0@lo:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592945.467891:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788592945.467904:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592945.467994:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226102656:0@lo:400:kworker.0 00000100:00100000:3.0:1788592945.468025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592945.468063:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226103168:0@lo:400:kworker.0 00000100:00100000:3.0:1788592945.468124:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592945.468142:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9218756c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226103680:0@lo:400:kworker.0 00000100:00100000:3.0:1788592945.468342:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592945.468383:0:19795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103168 00000100:00100000:3.0:1788592945.468387:0:19795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103168 00000100:00100000:3.0:1788592945.468419:0:19795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592945.468432:0:19795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592945.468467:0:19795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875475226103168:12345-0@lo:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592945.468473:0:19795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788592945.468490:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592945.468509:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1875475226103168:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.468597:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788592945.468602:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92187ed83b80, transno 8589934596 00000004:00080000:0.0:1788592945.468611:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788592945.468627:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1875475226102784:0@lo:400:kworker.0 00000100:00100000:0.0:1788592945.468641:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875475226103296:0@lo:400:kworker.0 00010000:00080000:0.0:1788592945.468781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9218756c7800 x1875475226103808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592945.468793:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1875475226103808:0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.469298:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226102656 00000100:00100000:1.0:1788592945.469306:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226102656 00000100:00100000:1.0:1788592945.469334:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788592945.469341:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226102656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.469409:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9217444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875475226102656:12345-0@lo:400:kworker.0 Request processed in 67us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592945.469416:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788592945.469434:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103680 00000100:00100000:1.0:1788592945.469438:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103680 00000100:00100000:1.0:1788592945.469468:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788592945.469474:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226103680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592945.469503:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92186f484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875475226103680:12345-0@lo:400:kworker.0 Request processed in 28us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592945.469509:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788592945.469567:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592945.469639:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1875475226102656:0@lo:400:kworker.0 00000100:00100000:2.0:1788592945.469650:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9218756c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1875475226103680:0@lo:400:kworker.0 00000001:02000400:2.0:1788592945.883999:0:20356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788592946.360514:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592946.617594:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617639:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617675:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617701:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617728:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617747:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617764:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617782:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:0.0:1788592946.617806:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.47@tcp (source: 12345-192.168.203.47@tcp) 00000100:00100000:3.0:1788592946.617995:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262848 00000100:00100000:3.0:1788592946.618004:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262848 00000100:00100000:3.0:1788592946.618112:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209263360 00000100:00100000:3.0:1788592946.618116:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209263360 00000100:00100000:3.0:1788592946.618133:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262976 00000100:00100000:3.0:1788592946.618136:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262976 00000100:00080000:0.0:1788592946.618261:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592946.618310:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209263104 00000100:00100000:0.0:1788592946.618328:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209263104 00000100:00100000:0.0:1788592946.618361:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209263616 00000100:00100000:0.0:1788592946.618364:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209263616 00000100:00100000:0.0:1788592946.618374:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209263232 00000100:00100000:0.0:1788592946.618376:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209263232 00000100:00100000:0.0:1788592946.618386:0:18763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209263744 00000100:00100000:0.0:1788592946.618388:0:18763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209263744 00000100:00100000:0.0:1788592946.618402:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:0.0:1788592946.618410:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209263104:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592946.618475:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209263104:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 65us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592946.618482:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 26 00000100:00100000:0.0:1788592946.618508:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:0.0:1788592946.618515:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209263616:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592946.618537:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209263616:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 23us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592946.618544:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 27 00000100:00100000:0.0:1788592946.618554:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1788592946.618561:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209263232:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592946.618594:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209263232:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 33us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592946.618600:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 28 00000100:00100000:0.0:1788592946.618612:0:18763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:0.0:1788592946.618619:0:18763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209263744:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592946.618660:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209263488 00000100:00100000:0.0:1788592946.618661:0:18763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209263744:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 42us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592946.618665:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209263488 00000100:00100000:0.0:1788592946.618676:0:18763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 29 00000100:00100000:1.0:1788592946.618698:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:0.0:1788592946.618701:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475209262720 00000100:00100000:0.0:1788592946.618706:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475209262720 00000100:00100000:1.0:1788592946.618710:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+22:2395:x1875475209262848:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592946.618737:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 167 00000100:00100000:0.0:1788592946.618744:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921743a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:2395:x1875475209262720:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:1.0:1788592946.618748:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1b09db4-0481-49f3-89da-591dd9a69226+22:2395:x1875475209262848:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 40us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592946.618758:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 66 00000100:00100000:0.0:1788592946.618774:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921743a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56318202-5ccc-4b18-bf05-3f29008f5167+13:2395:x1875475209262720:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 30us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592946.618779:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:0.0:1788592946.618788:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 167 00000100:00100000:1.0:1788592946.618794:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2395:x1875475209263360:12345-192.168.203.47@tcp:400:kworker.0 00000100:00080000:0.0:1788592946.618819:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788592946.618823:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592946.618826:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592946.618831:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+6:2395:x1875475209263360:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 42us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592946.618838:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 67 00000100:00100000:0.0:1788592946.618850:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00100000:0.0:1788592946.618859:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209263488:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:0.0:1788592946.618885:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ec773d5-3e7f-4fd1-b1ce-72f04c95df83+5:2395:x1875475209263488:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 28us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592946.618892:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 68 00000100:00080000:0.0:1788592946.628507:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788592946.628886:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.47@tcp, seq: 69 00000100:00100000:3.0:1788592946.628901:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209262976:12345-192.168.203.47@tcp:400:kworker.0 00000100:00100000:3.0:1788592946.629020:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1b09db4-0481-49f3-89da-591dd9a69226+5:2395:x1875475209262976:12345-192.168.203.47@tcp:400:kworker.0 Request processed in 123us (11272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592946.629028:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.47@tcp, seq: 69 00010000:00010000:3.0:1788592947.397496:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592947.513500:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592947.513524:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226103936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592947.513608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592947.513681:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475226103936 00000100:00100000:3.0:1788592947.513690:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475226103936 00000100:00100000:3.0:1788592947.513753:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592947.513762:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226103936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592947.513790:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788592947.513834:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff921744466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875475226103936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592947.513841:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788592947.513908:0:17176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592947.513942:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff921744557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1875475226103936:0@lo:13:osp-pre-0-0.0 Debug log: 41058 lines, 41058 kept, 0 dropped, 0 bad.